-- Logs begin at Fri 2022-06-24 07:20:53 UTC, end at Fri 2022-06-24 08:39:16 UTC. -- Jun 24 08:09:27.164801 dv-cinder-834822-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:09:27.174375 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:09:27 2022] *** Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: nodename: dv-cinder-834822-6-iscsi Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: machine: x86_64 Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: clock source: unix Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: pcre jit disabled Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: detected number of CPU cores: 4 Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: current working directory: / Jun 24 08:09:27.176376 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: your processes number limit is 47680 Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: your memory page size is 4096 bytes Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: detected max file descriptor number: 2048 Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: lock engine: pthread robust mutexes Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: thunder lock: enabled Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:09:27.177092 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:09:27.224650 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: Python main interpreter initialized at 0x562d752d39c0 Jun 24 08:09:27.224650 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: python threads support enabled Jun 24 08:09:27.224650 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: your server socket listen backlog is limited to 100 connections Jun 24 08:09:27.224650 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:09:27.225028 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:09:27.225106 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: *** Operational MODE: preforking *** Jun 24 08:09:27.225319 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:09:27.225319 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: spawned uWSGI master process (pid: 103740) Jun 24 08:09:27.225545 dv-cinder-834822-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:09:27.226451 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: spawned uWSGI worker 1 (pid: 103741, cores: 1) Jun 24 08:09:27.226451 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: spawned uWSGI worker 2 (pid: 103742, cores: 1) Jun 24 08:09:27.226613 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:09:27.887752 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:09:27.888336 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:09:29.017443 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:09:29.017443 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: from cryptography.utils import int_from_bytes Jun 24 08:09:29.018022 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:09:29.018022 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: from cryptography.utils import int_from_bytes Jun 24 08:09:29.018425 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:09:29.018425 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: from cryptography.utils import int_from_bytes Jun 24 08:09:29.018563 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:09:29.018563 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: from cryptography.utils import int_from_bytes Jun 24 08:09:31.519234 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:09:31.519894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:09:31.519991 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:09:31.520375 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:09:31.520635 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:09:31.521046 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.521374 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.521723 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.522060 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.522392 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.522568 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:09:31.522952 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.523037 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:09:31.523116 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.523335 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:09:31.523423 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.523662 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.523754 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:09:31.523924 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.524010 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:09:31.524265 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.524356 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.524594 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-6-iscsi {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.524703 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.524915 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525066 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525227 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525313 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525538 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525626 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525853 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.525947 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.526155 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.526248 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.526466 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.526550 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.526768 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.526854 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.527029 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.527271 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.527374 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.527654 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-6-iscsi {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.527970 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.528072 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.528293 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.528403 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.528600 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.528693 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.528913 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529005 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529213 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529372 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529537 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529634 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529812 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.529911 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.530714 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.531063 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.531307 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.531462 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.531635 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.531865 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-6-iscsi {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.531958 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.532185 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.532351 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.532522 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.532659 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.532836 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.532924 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.533189 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.533275 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.533508 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.533650 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.533816 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.533903 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.534137 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.534237 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.534444 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.534581 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.534753 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.534849 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-6-iscsi {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.535087 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.535473 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.535674 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.535777 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.535992 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.536091 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.536337 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.536440 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.536644 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.536741 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.536953 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537040 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537262 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537348 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537579 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537667 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537885 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.537971 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.538189 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.538275 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.538439 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.538526 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.538745 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.538854 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539064 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539192 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539383 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539471 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539688 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539782 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.539940 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540036 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540190 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540314 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540527 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540613 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540844 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.540949 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.541130 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.541216 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.541430 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.541516 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.541737 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.541832 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542042 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542129 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542346 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542441 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542591 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542836 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.542930 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.543147 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.543235 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.543459 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.543549 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.543761 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.543847 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.544062 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.544163 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.544457 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.544544 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.544757 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.544842 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.545165 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.545308 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.545419 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.545506 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.545726 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.546406 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.546624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.546945 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.547092 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.547253 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.547418 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.547573 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.547739 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.547895 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.548061 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.548218 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.548394 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.548535 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.548719 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.548841 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.549115 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.549201 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.549367 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.549482 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.549674 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.549770 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550024 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550111 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550326 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550420 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550630 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550717 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.550948 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551034 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551254 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551341 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551561 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551650 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551862 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.551955 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.552162 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.552266 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.552497 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.552593 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.552804 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.552890 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553110 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553209 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553358 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553445 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553657 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553752 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.553956 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554058 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554271 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554358 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554572 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554665 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554874 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.554976 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.555176 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.555269 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.555473 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.555563 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.555775 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.555872 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.556076 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.556162 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.556401 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.556489 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.556702 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.556807 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557004 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557091 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557302 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557389 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557604 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557704 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557905 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.557993 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.558210 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.558296 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.558514 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.558601 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.558827 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.558919 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.559129 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.559222 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.559430 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.559521 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.559731 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.559827 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560033 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560155 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560366 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560464 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560666 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560751 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.560966 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.561060 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.561270 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.561398 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.561636 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.561944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.562143 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.562337 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.562470 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.562647 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.562795 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.562935 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.563108 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.563246 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.563419 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.563549 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.563738 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.563868 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.564040 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.564188 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.564374 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.564522 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.564699 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.564816 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.565017 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.565131 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.565325 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.565446 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.565632 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.565776 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.565938 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.566111 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.566245 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.566446 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.566541 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.566766 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.566869 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.567098 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.567193 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.567414 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.567504 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.567731 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.567833 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.568043 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.568134 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.568376 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.568468 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.568681 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.568786 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.568984 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.569084 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.569302 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:09:31.569400 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.569612 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.569721 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.569934 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570026 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570254 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570351 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570580 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570716 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570893 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.570985 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.571211 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.571299 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.571527 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.571624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.571836 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.571921 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.572146 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.572283 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.572492 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.572590 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.572801 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.572896 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.573111 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.573199 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.573421 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.573509 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.573737 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.573824 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.574051 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.574138 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.574377 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.574466 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.574691 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.574786 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575005 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575093 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575317 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575404 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575626 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575712 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.575941 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.576057 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.576291 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.576426 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.576615 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.576731 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.576923 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.577051 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.577502 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.577859 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.577976 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.578178 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.578291 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.578479 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.578588 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.578796 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.578917 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.579138 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.579258 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.579455 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.579576 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.579772 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.579884 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.580085 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.580221 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.580458 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.580585 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.580814 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.580914 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581036 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581209 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581346 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581538 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581653 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581850 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.581946 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.582162 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.582248 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.582473 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.582568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.582783 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.582885 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.583092 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.583186 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.583425 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.583511 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.583738 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.583833 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.584051 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.584139 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.584383 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.584473 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.584694 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.584790 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585002 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585094 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585308 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585402 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585613 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585701 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585913 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.585999 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.586214 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.586300 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.586513 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.586607 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.586820 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.586907 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.587121 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.587208 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.587423 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.587511 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.587744 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.587831 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588045 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588131 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588373 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588463 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588689 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588776 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.588997 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.589095 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.589303 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.589398 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.589608 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.589702 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.589910 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590006 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590220 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590528 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590625 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590830 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.590965 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.591151 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.591238 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.591458 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.591545 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.591759 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.591855 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.592076 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.592163 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.592405 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.592495 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.593242 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.593617 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.593709 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594010 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594096 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594319 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594414 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594626 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594713 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.594932 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595027 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595242 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595338 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595552 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595639 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595855 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.595949 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.596157 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.596278 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.596486 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.596574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.596791 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.596890 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.597112 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.597200 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.597421 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.597515 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.597726 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.597820 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598029 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598124 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598332 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598421 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598640 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598735 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.598948 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599044 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599250 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599337 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599552 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599646 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599857 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.599944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.600156 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.600275 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.600479 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.600574 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.600779 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.600867 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601077 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601161 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601376 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601475 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601691 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601785 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.601995 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602089 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602297 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602392 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602597 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602683 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602896 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.602990 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.603232 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.603332 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.603533 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.603619 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.603853 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.603938 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.604174 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.604310 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.604502 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.604590 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.604819 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.604905 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.605127 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.605214 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.605439 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.605526 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.605750 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.605836 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606057 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606145 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606363 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606448 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606671 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606758 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.606987 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607082 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607293 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607380 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607602 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607761 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607908 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.607995 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.608259 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.608929 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.609154 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.609473 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.609623 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.609786 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.609957 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.610111 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.610271 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.610421 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.610594 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.610740 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.610938 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.611073 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.611273 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.611373 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.611593 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.611680 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.611918 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612005 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612260 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612367 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612581 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612669 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612892 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.612978 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.613201 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.613288 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.613510 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.613596 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.613819 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.613906 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.614122 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.614208 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.614428 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.614515 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.614739 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.614826 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615047 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615134 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615362 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615454 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615665 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615751 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.615967 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.616055 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.616296 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.616387 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.616610 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.616710 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.616935 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617022 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617258 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617352 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617566 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617661 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617875 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.617969 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.618196 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.618282 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.618503 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.618599 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.618809 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.618903 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.619115 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.619200 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.619420 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.619519 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.619722 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.619809 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620031 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620182 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620366 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620455 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620674 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620761 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.620982 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.621070 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.621284 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.621362 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.621593 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.621679 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.621897 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.622009 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.622197 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.622351 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.622497 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.622707 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.622794 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.623022 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.623125 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.623361 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.623447 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.623693 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.623787 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.624050 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.624161 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.624542 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.624858 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.624947 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.625170 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.625271 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.625496 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.625584 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.625811 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.625897 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.626115 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.626215 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.626420 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.626506 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.626723 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.626809 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.627066 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.627165 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.627379 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.627466 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.627684 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.627771 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628001 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628090 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628349 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628452 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628660 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628755 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.628974 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.629242 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.629330 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.629576 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.629662 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.629893 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.629989 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.630205 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.630291 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.630515 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.630602 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.630823 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.630919 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.631131 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.631216 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.631440 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.631516 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.631749 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.631837 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.632069 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.632165 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.632401 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.632502 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.632707 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.632794 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633012 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633107 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633312 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633399 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633615 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633709 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.633921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.634008 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.634226 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.634478 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.634572 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.634808 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.634897 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.635116 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.635203 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.635426 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.635513 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.635731 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.635828 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.636044 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.636131 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.636384 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.636489 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.636698 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.636795 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637004 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637100 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637325 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637421 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637725 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.637929 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638015 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638228 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638314 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638530 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638631 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638830 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.638915 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.639134 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.639220 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.639440 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.639567 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.639838 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.640174 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.640301 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.640503 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.640604 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.640809 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.640906 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.641134 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.641221 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.641440 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.641578 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.641745 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.641833 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642050 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642142 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642360 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642448 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642668 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642754 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.642969 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643056 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643282 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643414 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643580 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643666 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643883 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.643970 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.644185 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.644293 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.644509 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.644595 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.644819 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.644909 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.645123 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.645211 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.645444 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.645530 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.645752 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.645856 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646055 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646359 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646476 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646670 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646798 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.646979 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647102 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647282 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647402 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647595 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647692 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647899 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.647985 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.648239 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.648330 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.648539 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.648638 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.648843 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.648930 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.649146 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.649232 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.649456 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.649551 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.649767 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.649854 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650062 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650148 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650370 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650458 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650670 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650756 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.650972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651064 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651276 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651364 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651577 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651654 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651877 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.651962 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.652180 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.652333 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.652507 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.652602 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.652806 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.652901 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.653114 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.653201 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.653414 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.653501 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.653726 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.653821 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654024 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654110 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654324 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654412 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654624 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654719 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.654930 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.655017 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.655778 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.656081 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.656337 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.656442 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.656557 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.656707 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.656885 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657013 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657198 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657337 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657506 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657649 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657809 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.657956 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.658118 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.658261 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.658420 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.658568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.658721 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.658913 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659030 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659219 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659350 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659577 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659673 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659884 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.659979 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.660473 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.660569 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.660795 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.660882 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.661109 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.661198 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.661411 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.661498 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.661718 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.661804 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662019 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662108 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662318 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662404 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662616 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662703 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.662916 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663006 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663215 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663302 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663517 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663604 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663829 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.663916 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.664130 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.664242 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.664457 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.664546 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.664759 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.664849 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.665081 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.665167 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.665390 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.665486 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.665704 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.665791 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666014 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666103 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666325 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666421 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666635 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666722 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.666939 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667026 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667247 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667341 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667553 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667647 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667852 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.667946 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.668163 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.668283 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.668489 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.668577 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.668797 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.668885 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.669095 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.669183 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.669394 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.669489 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.669703 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.669790 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.670010 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.670098 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.670316 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.670402 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.670630 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.670725 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.671018 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.671311 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.671573 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.671672 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.671912 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672043 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672235 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672380 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672559 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672665 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672874 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.672971 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.673186 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.673273 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.673494 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.673580 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.673803 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.673900 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.674113 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.674202 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.674422 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.674511 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.674731 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.674827 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675041 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675129 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675349 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675435 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675651 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675746 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.675959 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.676053 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.676294 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.676396 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.676602 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.676697 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.676925 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677013 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677235 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677322 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677538 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677626 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677844 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.677931 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.678143 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.678237 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.678446 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.678534 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.678744 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.678829 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.679059 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.679165 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.679388 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.679485 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.679767 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.679853 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.680070 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.680166 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.680398 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.680486 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.680706 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.680792 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.681017 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.681121 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.681324 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.681411 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.681628 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.681714 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682023 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682120 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682332 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682425 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682640 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682727 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.682945 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683041 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683245 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683333 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683545 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683632 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683848 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.683938 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.684166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.684325 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.684489 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.684576 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.684790 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.684877 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.685091 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.685177 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.685408 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.685495 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.685708 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.685803 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.686023 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.686120 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.686459 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.686553 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.686782 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.687045 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.687179 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.687352 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.687509 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.687766 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.687862 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.688075 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.688172 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.688408 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.688496 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.688729 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.688816 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689047 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689135 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689353 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689439 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689656 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689742 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.689971 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690060 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690278 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690372 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690586 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690673 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690897 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.690994 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.691200 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.691293 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.691502 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.691596 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.691803 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.691891 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.692116 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.692261 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.692457 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.692560 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.692768 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.692854 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.693087 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.693181 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.693404 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.693498 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.693708 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.693797 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694030 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694130 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694341 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694436 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694647 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694734 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.694952 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695039 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695259 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695355 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695583 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695669 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695885 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.695972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.696188 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.696328 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.696526 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.696614 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.696828 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.696915 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.697136 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.697225 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.697443 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.697529 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.697748 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.697834 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698050 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698138 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698350 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698438 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698669 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698755 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.698969 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699057 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699364 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699590 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699685 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.699982 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.700214 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.700305 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.700522 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.700619 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.700828 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.700923 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.701129 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.701217 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.701430 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.701525 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.701727 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.701813 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.702576 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.702708 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.702883 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.703207 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.703343 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.703517 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.703657 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.703822 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.703985 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.704125 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.704341 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.704464 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.704671 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.704805 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.704983 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.705111 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.705317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.705444 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.705646 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.705763 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.705963 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.706090 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.706281 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.706438 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.706604 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.706751 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.706907 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.707076 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.707210 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.707394 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.707520 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.707710 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.707821 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708026 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708113 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708367 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708457 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708683 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708771 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.708998 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709093 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709297 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709383 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709597 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709692 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709912 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.709999 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.710214 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.710307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.710531 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.710628 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.710837 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.711047 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.711142 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.711376 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.711473 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.711691 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.711778 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712005 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712093 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712338 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712430 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712652 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712790 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.712963 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713055 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713273 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713361 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713584 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713671 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713893 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.713979 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.714199 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.714294 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.714517 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.714602 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.714829 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.714935 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.715142 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.715237 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.715455 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.715554 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.715766 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.715864 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.716080 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.716169 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.716417 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.716508 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.716723 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.716820 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.717035 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.717123 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.717345 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.717439 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.717714 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.718364 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.718523 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.718869 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.719235 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.719324 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.719547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.719636 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.719858 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.719961 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.720171 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.720360 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.720508 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.720598 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.720820 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.720907 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.721130 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.721227 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.721442 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.721530 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.721754 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.721841 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.722065 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.722163 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.722374 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.722471 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.722699 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.722825 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723011 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723109 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723326 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723423 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723642 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723730 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.723958 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.724159 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.724294 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.724498 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.724608 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.724831 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.724930 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.725158 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.725245 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.725483 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.725570 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.725799 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.725889 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.726123 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.726219 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.726442 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.726528 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.726745 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.726832 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727050 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727136 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727356 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727443 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727663 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727762 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.727967 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.728054 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.728306 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.728408 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.728614 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.728701 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.728915 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.729000 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.729219 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.729318 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.729535 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.729621 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.729861 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.730063 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.730184 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.730412 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.730501 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.730730 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.730818 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.731057 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.731153 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.731381 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.731583 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.731699 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.731898 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.732007 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.732247 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.732340 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.732571 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.732658 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.732891 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.733017 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.733201 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.733318 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.733614 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.733921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734008 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734227 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734329 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734537 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734632 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734839 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.734925 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.735139 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.735235 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.735445 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.735539 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.735744 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.735866 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736061 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736149 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736394 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736485 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736696 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736783 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.736998 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.737086 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.737306 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.737393 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.737608 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.737828 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.737925 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.738169 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.738257 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.738480 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.738575 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.738789 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.738890 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.739094 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.739181 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.739402 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.739489 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.739703 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.739790 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740009 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740095 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740337 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740429 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740638 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740732 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.740947 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741035 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741253 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741340 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741552 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741640 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741850 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.741937 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.742154 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.742241 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.742459 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.742547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.742758 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.742853 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743063 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743205 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743359 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743483 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743678 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743766 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.743978 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.744074 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.744305 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.744553 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.744641 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.744892 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.744992 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.745189 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.745281 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.745489 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.745577 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.745790 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.745877 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.746089 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.746185 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.746395 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.746482 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.746694 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.746836 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747052 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747138 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747365 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747451 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747671 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747835 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.747978 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.748066 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.748310 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.748401 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.748621 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.748724 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.748979 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.749136 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.749287 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.749600 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.749800 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.749910 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.750116 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.750204 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.750441 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.750535 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.750764 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.750860 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.751090 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.751178 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.751403 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.751490 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.751714 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.751810 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.752043 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.752136 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.752387 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.752476 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.752704 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.752916 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.753006 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.753250 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.753327 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.753571 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.753666 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.753905 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754001 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754212 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754310 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754526 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754615 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754831 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.754918 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.755138 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.755225 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.755450 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.755537 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.755760 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.755855 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.756070 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.756166 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.756404 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.756493 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.756715 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.756814 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757023 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757125 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757331 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757420 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757637 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757724 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.757946 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758041 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758251 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758347 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758558 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758646 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758864 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.758994 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.759170 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.759292 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.759474 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.759586 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.759785 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.759914 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.760119 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.760226 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.760463 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.760550 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.760779 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.760868 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.761092 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.761181 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.761407 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.761494 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.761715 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.761804 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762022 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762116 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762326 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762422 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762631 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762725 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.762932 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763018 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763238 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763335 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763543 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763630 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763842 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.763928 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.764149 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.764280 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.764974 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.765099 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.765396 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.765705 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.765944 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766033 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766271 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766358 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766586 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766679 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766898 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.766993 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.767203 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.767298 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.767512 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.767608 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.767818 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.767907 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.768124 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.768229 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.768455 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.768551 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.768788 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.768877 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.769125 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.769220 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.769490 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.769595 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.769771 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.769866 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.770074 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.770160 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.770376 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.770473 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.770686 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.770775 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771005 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771092 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771312 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771408 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771611 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771698 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771909 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.771996 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.772232 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.772324 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.772535 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.772632 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.772836 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.772932 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.773165 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.773285 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.773479 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.773608 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.773793 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.773890 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.774107 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.774196 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.774435 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.774523 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.774744 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.774839 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775043 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775132 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775341 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775428 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775640 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775736 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.775944 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776031 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776261 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776351 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776565 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776665 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776863 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.776950 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.777162 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.777249 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.777460 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.777621 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.777786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.777873 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.778111 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.778198 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.778422 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.778510 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.778741 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.778827 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779045 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779140 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779392 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779489 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779662 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779757 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.779978 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.780066 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.780374 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.780709 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.780836 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.781055 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.781143 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.781371 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.781474 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.781716 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.781804 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782046 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782134 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782364 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782453 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782677 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782771 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.782981 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.783067 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.783226 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:09:31.783316 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.783589 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.783916 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.784261 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.784571 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.784897 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.785475 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.785794 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.786110 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.786420 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.786747 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.787057 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.787364 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.787678 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.787989 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.788324 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.788643 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.788959 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.789284 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.789606 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.789915 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.790238 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.790563 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.790905 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.791220 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.791559 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.791883 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.792215 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.792527 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.792831 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:09:31.793072 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:09:31.937510 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Registered counter for database nova_api Jun 24 08:09:31.952987 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO dbcounter [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Registered counter for database nova_api Jun 24 08:09:31.958237 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:31.964696 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:31.972873 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_db.sqlalchemy.engines [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:31.979232 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writer thread running {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.023373 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.context [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),081d19cb-2fd5-4e7c-8144-7f74f0537b29(cell1) {{(pid=103741) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:09:32.027230 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:09:32.028845 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:09:32.029625 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:09:32.031727 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:09:32.033716 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Registered counter for database nova_cell0 Jun 24 08:09:32.038066 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Registered counter for database nova_cell1 Jun 24 08:09:32.038511 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.context [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),081d19cb-2fd5-4e7c-8144-7f74f0537b29(cell1) {{(pid=103742) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:09:32.042426 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_concurrency.lockutils [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:09:32.043991 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_concurrency.lockutils [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:09:32.044805 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_concurrency.lockutils [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:09:32.046527 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:32.048022 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_concurrency.lockutils [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:09:32.048463 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:32.050183 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO dbcounter [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Registered counter for database nova_cell0 Jun 24 08:09:32.053496 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.054241 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO dbcounter [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Registered counter for database nova_cell1 Jun 24 08:09:32.059341 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.061302 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_db.sqlalchemy.engines [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:32.064389 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_db.sqlalchemy.engines [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:32.069284 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writer thread running {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.071999 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writer thread running {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.200800 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Registered counter for database nova_cell0 Jun 24 08:09:32.207623 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:32.212322 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.219807 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO dbcounter [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Registered counter for database nova_cell0 Jun 24 08:09:32.226395 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG oslo_db.sqlalchemy.engines [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:09:32.230597 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writer thread running {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:09:32.665988 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:09:32.673454 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:09:32.709126 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: WARNING keystonemiddleware.auth_token [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:09:32.716328 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: WARNING keystonemiddleware.auth_token [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:09:33.012646 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:09:33.018882 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:09:33.024116 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d752d39c0 pid: 103741 (default app) Jun 24 08:09:33.026211 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:09:33.027374 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Jun 24 08:09:33.027778 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Fri Jun 24 08:09:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:09:33.055871 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: WARNING keystonemiddleware.auth_token [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:09:33.061883 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: WARNING keystonemiddleware.auth_token [None req-4037ec33-5a91-4166-8303-c03f354eac8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:09:33.067179 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d752d39c0 pid: 103742 (default app) Jun 24 08:10:51.953769 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:10:51.955504 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002759 Jun 24 08:10:51.956012 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:10:51.974254 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writing DB stats nova_api:SELECT=3 {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:51.975214 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writing DB stats nova_cell1:SELECT=3 {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:51.975993 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writing DB stats nova_cell0:SELECT=3 {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:51.976849 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:52.414971 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-93a387bb-5fd4-421d-8073-b7e09127901a admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:10:52.450470 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-93a387bb-5fd4-421d-8073-b7e09127901a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487337 Jun 24 08:10:52.456814 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 24 08:10:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:10:54.552122 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:10:54.553194 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4429859c-e86c-4f2f-944e-c03845c83309 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 24 08:10:54.553599 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:10:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:10:54.619915 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-636abb5c-1c3b-41f7-991d-80ba263da8e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "c1"}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:10:54.640690 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:10:54.640690 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: warnings.warn(msg) Jun 24 08:10:54.737960 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-636abb5c-1c3b-41f7-991d-80ba263da8e6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.178163 Jun 24 08:10:54.739024 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:10:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:10:54.960445 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-7839f045-9baa-4b7c-bf0e-b3d09829b87b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:10:54.962894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:10:54.962894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 24 08:10:54.965583 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=3 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:54.966388 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell0:SELECT=3 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:54.967563 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell1:SELECT=3 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:54.968988 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:55.113166 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-7839f045-9baa-4b7c-bf0e-b3d09829b87b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.365465 Jun 24 08:10:55.114006 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 24 08:10:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:10:57.323139 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-636abb5c-1c3b-41f7-991d-80ba263da8e6 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:10:57.324165 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-636abb5c-1c3b-41f7-991d-80ba263da8e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 24 08:10:57.324603 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:10:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:10:57.436523 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-fba57278-0685-4a6c-84a3-f1370cce0cfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:10:57.454967 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:10:57.454967 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 24 08:10:57.564664 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-fba57278-0685-4a6c-84a3-f1370cce0cfa admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.233998 Jun 24 08:10:57.576924 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:10:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:10:57.582607 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-4678cc36-8dae-4b42-812e-52906437e30d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:10:57.584353 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:10:57.584353 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: warnings.warn(msg) Jun 24 08:10:57.678074 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-4678cc36-8dae-4b42-812e-52906437e30d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099810 Jun 24 08:10:57.678838 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 24 08:10:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:10:59.779372 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-fba57278-0685-4a6c-84a3-f1370cce0cfa admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:10:59.780426 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-fba57278-0685-4a6c-84a3-f1370cce0cfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 24 08:10:59.781365 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:10:59.841947 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-dd5ef5ab-7a39-4c4f-9182-a6f8a05b614f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:10:59.952172 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-dd5ef5ab-7a39-4c4f-9182-a6f8a05b614f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164793 Jun 24 08:10:59.953572 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:10:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:10:59.967800 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-fd8b207e-6730-4a72-83a8-bc7bc4b4c399 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:00.064756 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-fd8b207e-6730-4a72-83a8-bc7bc4b4c399 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101031 Jun 24 08:11:00.065621 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 24 08:10:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:02.160680 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-dd5ef5ab-7a39-4c4f-9182-a6f8a05b614f admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:02.161688 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-dd5ef5ab-7a39-4c4f-9182-a6f8a05b614f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 24 08:11:02.162087 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:02.220170 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-6e859a4a-1a15-4bee-87cf-8039b5e2ac5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "ram": 2048, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:02.311453 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-6e859a4a-1a15-4bee-87cf-8039b5e2ac5e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143473 Jun 24 08:11:02.313576 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:02.325288 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-19ae3737-ab4d-4e29-bbd6-27f804c5ef59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:02.389059 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-19ae3737-ab4d-4e29-bbd6-27f804c5ef59 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067412 Jun 24 08:11:02.389804 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 24 08:11:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:04.509004 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-6e859a4a-1a15-4bee-87cf-8039b5e2ac5e admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:04.510820 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-6e859a4a-1a15-4bee-87cf-8039b5e2ac5e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002320 Jun 24 08:11:04.511377 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:04.579113 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-ca707d95-a6a2-4fa4-82f0-e14565d1d153 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:04.674015 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-ca707d95-a6a2-4fa4-82f0-e14565d1d153 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155543 Jun 24 08:11:04.674605 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:04.686881 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-a71bec2f-58fe-455d-8898-e38830f271da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:04.769953 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-a71bec2f-58fe-455d-8898-e38830f271da admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086938 Jun 24 08:11:04.770863 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 24 08:11:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:06.871141 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-ca707d95-a6a2-4fa4-82f0-e14565d1d153 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:06.872144 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-ca707d95-a6a2-4fa4-82f0-e14565d1d153 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 24 08:11:06.872656 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:06.932034 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-198ce93f-aa6f-4661-ae28-56ead16b37a9 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:06.955140 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-198ce93f-aa6f-4661-ae28-56ead16b37a9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075888 Jun 24 08:11:06.955671 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 24 08:11:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:11:09.063334 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-ca707d95-a6a2-4fa4-82f0-e14565d1d153 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:09.064795 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-ca707d95-a6a2-4fa4-82f0-e14565d1d153 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jun 24 08:11:09.065319 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:09.126724 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-f6b7a05c-9c43-4a4f-97d5-e5ef343f11b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:09.211644 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-f6b7a05c-9c43-4a4f-97d5-e5ef343f11b8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.139076 Jun 24 08:11:09.212215 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:11:09.226110 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-63d34c8e-2d3e-4a2b-b5dd-167c03abc3c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:09.322297 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-63d34c8e-2d3e-4a2b-b5dd-167c03abc3c6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101278 Jun 24 08:11:09.323037 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 24 08:11:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:11.420953 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-f6b7a05c-9c43-4a4f-97d5-e5ef343f11b8 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:11.422590 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-f6b7a05c-9c43-4a4f-97d5-e5ef343f11b8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Jun 24 08:11:11.423032 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:11.485067 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-b13a5249-e992-467b-b76d-8e526b0e52da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "ram": 2048}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:11.561286 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-b13a5249-e992-467b-b76d-8e526b0e52da admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131421 Jun 24 08:11:11.562276 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:11.580030 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-d89a6858-a256-4cfb-9a85-0535b6bdb83f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:11.717647 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-d89a6858-a256-4cfb-9a85-0535b6bdb83f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144556 Jun 24 08:11:11.718274 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 24 08:11:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:13.809544 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-b13a5249-e992-467b-b76d-8e526b0e52da admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:13.810498 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-b13a5249-e992-467b-b76d-8e526b0e52da admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 24 08:11:13.810901 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:13.870144 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-67203794-8cf2-4c2c-9792-babe23d3a597 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "swap": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:13.999215 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-67203794-8cf2-4c2c-9792-babe23d3a597 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.182159 Jun 24 08:11:13.999946 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:11:14.011476 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-b5ec319e-7515-46af-b17e-cba2bc2ddf67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:14.138849 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-b5ec319e-7515-46af-b17e-cba2bc2ddf67 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130733 Jun 24 08:11:14.139356 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 24 08:11:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:16.217457 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-67203794-8cf2-4c2c-9792-babe23d3a597 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:16.219210 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-67203794-8cf2-4c2c-9792-babe23d3a597 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jun 24 08:11:16.219632 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:16.277588 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-b9782be6-6b3b-40ca-a1e9-7eb6423d85ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:16.353634 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-b9782be6-6b3b-40ca-a1e9-7eb6423d85ac admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128119 Jun 24 08:11:16.354211 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:11:16.366416 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-d1c06d58-b56f-497f-a552-d444dadcb8f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:16.437721 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-d1c06d58-b56f-497f-a552-d444dadcb8f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074571 Jun 24 08:11:16.438229 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 24 08:11:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:18.522093 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-b9782be6-6b3b-40ca-a1e9-7eb6423d85ac admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:18.523102 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-b9782be6-6b3b-40ca-a1e9-7eb6423d85ac admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 24 08:11:18.523498 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:18.582871 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2a582169-3ab0-4599-84ac-c023239fdc2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "disk": 160, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:18.667952 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2a582169-3ab0-4599-84ac-c023239fdc2c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.138730 Jun 24 08:11:18.668539 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 24 08:11:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:18.681130 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-cd9032a4-34e4-4f12-8ad0-b2d7e1bed27b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:18.751928 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-cd9032a4-34e4-4f12-8ad0-b2d7e1bed27b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074549 Jun 24 08:11:18.752546 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 24 08:11:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:11:44.602434 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2a582169-3ab0-4599-84ac-c023239fdc2c admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:44.603447 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2a582169-3ab0-4599-84ac-c023239fdc2c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 24 08:11:44.603847 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:44.614343 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:44.663034 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-cee3b29a-f9fd-4495-a868-62547d31045b admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:44.681019 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-cee3b29a-f9fd-4495-a868-62547d31045b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071178 Jun 24 08:11:44.681559 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 24 08:11:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:11:45.597754 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2a582169-3ab0-4599-84ac-c023239fdc2c admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:45.598755 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2a582169-3ab0-4599-84ac-c023239fdc2c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 24 08:11:45.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:45.790978 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-fcaab401-fc3d-4f60-8848-dd038bd6014d admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:45.796969 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.wsgi [None req-fcaab401-fc3d-4f60-8848-dd038bd6014d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-fcaab401-fc3d-4f60-8848-dd038bd6014d admin admin] Request method failure captured: Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Accept: application/json Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Accept-Encoding: gzip, deflate Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Connection: keep-alive Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Content-Length: 0 Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Host: 10.222.0.42 Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Openstack-Api-Version: compute 2.90 Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Openstack-System-Scope: None Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: User-Agent: python-novaclient Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Auth-Token: gAAAAABitXHBwgyykWMPlM_8g0eXuTlaZ12V9BNVYuY_dMrsJsjAFl7UvEOxj0_g9g6PRg34l24-VKvRa6jedFIHQ6rNIR7P67qSLkkDklGfzxwIsjlX2veqGUo9D9YRyJGxKwiZNUO58NE-U1VZGGW7EAl6We9Zq25QuZDvhiKN8N5tXctEjZU Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Domain-Id: None Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Domain-Name: None Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Identity-Status: Confirmed Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Is-Admin-Project: True Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Domain-Id: default Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Domain-Name: Default Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Name: admin Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Role: member,reader,admin Jun 24 08:11:45.800149 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Roles: member,reader,admin Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ed29b44386f4c7ba3757cfe7b05f1c4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}] Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant: admin Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant-Name: admin Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User: admin Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Domain-Id: default Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Domain-Name: Default Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Id: 173c08a245ff42c4826381dd87480484 Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Name: admin Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: method: > Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: exception: Flavor 42 could not be found. Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: action_args: {'id': '42'} Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:11:45.801786 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:45.802868 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.804317 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-fcaab401-fc3d-4f60-8848-dd038bd6014d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:11:45.805601 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-fcaab401-fc3d-4f60-8848-dd038bd6014d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062187 Jun 24 08:11:45.805601 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 24 08:11:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:45.811155 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-b22b655f-a1e0-4c4a-b16f-3bf276d69dc3 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:45.814740 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:45.833485 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-b22b655f-a1e0-4c4a-b16f-3bf276d69dc3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025983 Jun 24 08:11:45.834019 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 24 08:11:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:11:45.843625 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-0d974f89-8fe8-4cae-ad5b-99a35673cb42 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:45.867166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-0d974f89-8fe8-4cae-ad5b-99a35673cb42 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027180 Jun 24 08:11:45.867683 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 24 08:11:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:11:45.877436 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-711fa563-e5eb-4ec8-abbb-e918fc8dd332 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:45.883400 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.wsgi [None req-711fa563-e5eb-4ec8-abbb-e918fc8dd332 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-711fa563-e5eb-4ec8-abbb-e918fc8dd332 admin admin] Request method failure captured: Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Accept: application/json Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Accept-Encoding: gzip, deflate Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Connection: keep-alive Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Content-Length: 0 Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Host: 10.222.0.42 Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Openstack-Api-Version: compute 2.90 Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Openstack-System-Scope: None Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: User-Agent: python-novaclient Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Auth-Token: gAAAAABitXHBwgyykWMPlM_8g0eXuTlaZ12V9BNVYuY_dMrsJsjAFl7UvEOxj0_g9g6PRg34l24-VKvRa6jedFIHQ6rNIR7P67qSLkkDklGfzxwIsjlX2veqGUo9D9YRyJGxKwiZNUO58NE-U1VZGGW7EAl6We9Zq25QuZDvhiKN8N5tXctEjZU Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Domain-Id: None Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Domain-Name: None Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Identity-Status: Confirmed Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Is-Admin-Project: True Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Domain-Id: default Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Domain-Name: Default Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Name: admin Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Role: member,reader,admin Jun 24 08:11:45.886678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Roles: member,reader,admin Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ed29b44386f4c7ba3757cfe7b05f1c4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}] Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant: admin Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant-Name: admin Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User: admin Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Domain-Id: default Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Domain-Name: Default Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Id: 173c08a245ff42c4826381dd87480484 Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Name: admin Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: method: > Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: exception: Flavor 42 could not be found. Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: action_args: {'id': '42'} Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:11:45.888278 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:45.889307 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:45.890972 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-711fa563-e5eb-4ec8-abbb-e918fc8dd332 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:11:45.894655 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-711fa563-e5eb-4ec8-abbb-e918fc8dd332 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014784 Jun 24 08:11:45.894655 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 24 08:11:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:46.722385 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-0d974f89-8fe8-4cae-ad5b-99a35673cb42 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:46.723455 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-0d974f89-8fe8-4cae-ad5b-99a35673cb42 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 24 08:11:46.723847 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:46.913715 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-0ba7702e-4411-422b-9345-813d53bbe4c7 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:46.920271 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.wsgi [None req-0ba7702e-4411-422b-9345-813d53bbe4c7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-0ba7702e-4411-422b-9345-813d53bbe4c7 admin admin] Request method failure captured: Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Accept: application/json Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Accept-Encoding: gzip, deflate Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Connection: keep-alive Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Content-Length: 0 Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Host: 10.222.0.42 Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Openstack-Api-Version: compute 2.90 Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Openstack-System-Scope: None Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: User-Agent: python-novaclient Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Auth-Token: gAAAAABitXHCTqEPTeAGeM7MSlKF4-m7rCjZ4epvQmS3yArpXNCCGKsO8MCfhFvrZzbMhVjk_BBP8sz7aP0_GCQIsGVegDJ06Iv0rug1vvwt_TJjz0kR0toNyq59vLXQp83_H3RU_p296p_ZDuvEZ0OcbMxNjEnVLRIBtAQAetb46tonR_lQJuY Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Domain-Id: None Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Domain-Name: None Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Identity-Status: Confirmed Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Is-Admin-Project: True Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Domain-Id: default Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Domain-Name: Default Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Name: admin Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Role: member,reader,admin Jun 24 08:11:46.921921 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Roles: member,reader,admin Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ed29b44386f4c7ba3757cfe7b05f1c4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}] Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant: admin Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant-Name: admin Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User: admin Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Domain-Id: default Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Domain-Name: Default Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Id: 173c08a245ff42c4826381dd87480484 Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Name: admin Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: method: > Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: exception: Flavor 84 could not be found. Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: action_args: {'id': '84'} Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:11:46.923547 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:46.924551 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.925657 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-0ba7702e-4411-422b-9345-813d53bbe4c7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:11:46.926720 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-0ba7702e-4411-422b-9345-813d53bbe4c7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061512 Jun 24 08:11:46.926720 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 24 08:11:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:46.933084 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-2d93fde8-026e-4ec5-8920-44c29438807d admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:46.947010 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-2d93fde8-026e-4ec5-8920-44c29438807d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017529 Jun 24 08:11:46.947536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 24 08:11:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:11:46.958075 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2b6cc2aa-3aca-4d55-953f-91d20936ae8b admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:46.973611 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2b6cc2aa-3aca-4d55-953f-91d20936ae8b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019286 Jun 24 08:11:46.974152 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 24 08:11:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:11:46.983235 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-ce99acc8-aa00-4f65-933d-3c0cc47b59af admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:46.988681 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.wsgi [None req-ce99acc8-aa00-4f65-933d-3c0cc47b59af admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-ce99acc8-aa00-4f65-933d-3c0cc47b59af admin admin] Request method failure captured: Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Accept: application/json Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Accept-Encoding: gzip, deflate Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Connection: keep-alive Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Content-Length: 0 Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Host: 10.222.0.42 Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Openstack-Api-Version: compute 2.90 Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Openstack-System-Scope: None Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: User-Agent: python-novaclient Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Auth-Token: gAAAAABitXHCTqEPTeAGeM7MSlKF4-m7rCjZ4epvQmS3yArpXNCCGKsO8MCfhFvrZzbMhVjk_BBP8sz7aP0_GCQIsGVegDJ06Iv0rug1vvwt_TJjz0kR0toNyq59vLXQp83_H3RU_p296p_ZDuvEZ0OcbMxNjEnVLRIBtAQAetb46tonR_lQJuY Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Domain-Id: None Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Domain-Name: None Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Identity-Status: Confirmed Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Is-Admin-Project: True Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Domain-Id: default Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Domain-Name: Default Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Name: admin Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Role: member,reader,admin Jun 24 08:11:46.990166 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Roles: member,reader,admin Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ed29b44386f4c7ba3757cfe7b05f1c4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}] Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant: admin Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant-Name: admin Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User: admin Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Domain-Id: default Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Domain-Name: Default Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Id: 173c08a245ff42c4826381dd87480484 Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Name: admin Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: method: > Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: exception: Flavor 84 could not be found. Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: action_args: {'id': '84'} Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:11:46.991629 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:46.992574 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:46.993902 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-ce99acc8-aa00-4f65-933d-3c0cc47b59af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:11:46.995228 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-ce99acc8-aa00-4f65-933d-3c0cc47b59af admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011771 Jun 24 08:11:46.995228 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 24 08:11:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 08:11:47.819764 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2b6cc2aa-3aca-4d55-953f-91d20936ae8b admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:47.820798 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2b6cc2aa-3aca-4d55-953f-91d20936ae8b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 24 08:11:47.821194 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:48.009791 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-7d21f612-f6d4-47f9-aae6-d70e5cb8891e admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:48.016027 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.wsgi [None req-7d21f612-f6d4-47f9-aae6-d70e5cb8891e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-7d21f612-f6d4-47f9-aae6-d70e5cb8891e admin admin] Request method failure captured: Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Accept: application/json Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Accept-Encoding: gzip, deflate Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Connection: keep-alive Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Content-Length: 0 Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Host: 10.222.0.42 Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Openstack-Api-Version: compute 2.90 Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Openstack-System-Scope: None Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: User-Agent: python-novaclient Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Auth-Token: gAAAAABitXHD-yawOmdSsSeMpL1H0YzbkUehW93PWFvs4I6vDQaarEJw3JcphRtFtwDiN9pI2tgiV5cIBFNDq_5TgcHUCAt65sqx6DrDAxqC5tXyYHXuL7vBEamreKQU8HYJIRvv86QrLUsaGl8eeZUyPLP4dK4piwLA4oERQ9No5j5BBDKBV_I Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Domain-Id: None Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Domain-Name: None Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Identity-Status: Confirmed Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Is-Admin-Project: True Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Domain-Id: default Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Domain-Name: Default Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Project-Name: admin Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Role: member,reader,admin Jun 24 08:11:48.017536 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Roles: member,reader,admin Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ed29b44386f4c7ba3757cfe7b05f1c4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}] Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant: admin Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-Tenant-Name: admin Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User: admin Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Domain-Id: default Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Domain-Name: Default Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Id: 173c08a245ff42c4826381dd87480484 Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: X-User-Name: admin Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: method: > Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: exception: Flavor 451 could not be found. Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: action_args: {'id': '451'} Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:11:48.019180 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:48.020264 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.021612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-7d21f612-f6d4-47f9-aae6-d70e5cb8891e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:11:48.022877 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-7d21f612-f6d4-47f9-aae6-d70e5cb8891e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059872 Jun 24 08:11:48.022877 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 24 08:11:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 08:11:48.028331 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-22991183-c6dd-4b42-a5c5-3125e5256e9b admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:48.042504 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-22991183-c6dd-4b42-a5c5-3125e5256e9b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017661 Jun 24 08:11:48.043021 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 24 08:11:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:11:48.052624 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:48.066100 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016968 Jun 24 08:11:48.066612 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 24 08:11:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:11:48.075538 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-5009d29a-5839-44fe-8319-be1bb605b86f admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:48.081384 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.wsgi [None req-5009d29a-5839-44fe-8319-be1bb605b86f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-5009d29a-5839-44fe-8319-be1bb605b86f admin admin] Request method failure captured: Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Accept: application/json Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Accept-Encoding: gzip, deflate Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Connection: keep-alive Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Content-Length: 0 Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Host: 10.222.0.42 Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Openstack-Api-Version: compute 2.90 Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Openstack-System-Scope: None Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: User-Agent: python-novaclient Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Auth-Token: gAAAAABitXHD-yawOmdSsSeMpL1H0YzbkUehW93PWFvs4I6vDQaarEJw3JcphRtFtwDiN9pI2tgiV5cIBFNDq_5TgcHUCAt65sqx6DrDAxqC5tXyYHXuL7vBEamreKQU8HYJIRvv86QrLUsaGl8eeZUyPLP4dK4piwLA4oERQ9No5j5BBDKBV_I Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Domain-Id: None Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Domain-Name: None Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Identity-Status: Confirmed Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Is-Admin-Project: True Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Domain-Id: default Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Domain-Name: Default Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Project-Name: admin Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Role: member,reader,admin Jun 24 08:11:48.082894 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Roles: member,reader,admin Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ed29b44386f4c7ba3757cfe7b05f1c4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ed29b44386f4c7ba3757cfe7b05f1c4"}]}] Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant: admin Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant-Id: 7ed29b44386f4c7ba3757cfe7b05f1c4 Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-Tenant-Name: admin Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User: admin Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Domain-Id: default Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Domain-Name: Default Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Id: 173c08a245ff42c4826381dd87480484 Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: X-User-Name: admin Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: method: > Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: exception: Flavor 451 could not be found. Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: action_args: {'id': '451'} Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:11:48.084568 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:48.085624 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 24 08:11:48.086944 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-5009d29a-5839-44fe-8319-be1bb605b86f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:11:48.088238 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-5009d29a-5839-44fe-8319-be1bb605b86f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012159 Jun 24 08:11:48.088467 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 24 08:11:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:48.899474 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:48.900506 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 24 08:11:48.900903 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:49.092327 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-cefa1e02-e8fd-420d-b69d-bcc9bbda57ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:49.204960 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-cefa1e02-e8fd-420d-b69d-bcc9bbda57ba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.163898 Jun 24 08:11:49.205456 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 24 08:11:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:50.038820 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:50.040112 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jun 24 08:11:50.040543 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:50.229815 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-d637e0a8-265d-44bb-b94f-78f4a7fc2444 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:50.340056 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-d637e0a8-265d-44bb-b94f-78f4a7fc2444 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.161718 Jun 24 08:11:50.340649 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 24 08:11:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:51.156346 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:51.157420 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Jun 24 08:11:51.157811 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:51.346583 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-fdbaf1b1-3a4b-4e6a-8164-2f6fb731b40c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:51.438479 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-fdbaf1b1-3a4b-4e6a-8164-2f6fb731b40c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.142620 Jun 24 08:11:51.438949 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 24 08:11:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:11:52.262596 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:52.263606 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 24 08:11:52.264008 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:52.454898 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2621f992-dcd6-4b56-9922-9a9657b89cd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:11:52.523526 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2621f992-dcd6-4b56-9922-9a9657b89cd3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.120893 Jun 24 08:11:52.528903 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 24 08:11:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:11:53.348241 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:53.349239 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 24 08:11:53.349625 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:11:53.541818 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-c9cf007f-2280-4b0b-9cfe-3ddd838eafe6 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:11:53.562569 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-c9cf007f-2280-4b0b-9cfe-3ddd838eafe6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072032 Jun 24 08:11:53.562569 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Fri Jun 24 08:11:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:12:40.698760 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:12:40.699759 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-052ff5c0-a79e-4da1-a29b-8f0b38a09044 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 24 08:12:40.700150 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 24 08:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:12:40.711180 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:12:40.761392 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2186be57-96c3-4523-9abb-5ce053c95109 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:12:40.779749 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2186be57-96c3-4523-9abb-5ce053c95109 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072911 Jun 24 08:12:40.780300 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 24 08:12:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:12:40.803374 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-d96cb970-5f02-425a-8a8c-1796615ce8cf admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:12:40.806818 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG dbcounter [-] [103742] Writing DB stats nova_api:SELECT=14 {{(pid=103742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:12:40.811701 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-d96cb970-5f02-425a-8a8c-1796615ce8cf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011937 Jun 24 08:12:40.812854 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Fri Jun 24 08:12:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:12:40.824023 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-b67ddebb-9ef6-4b91-ac54-4b462b8f962e admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:12:40.832509 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-b67ddebb-9ef6-4b91-ac54-4b462b8f962e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011918 Jun 24 08:12:40.832962 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Fri Jun 24 08:12:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:12:40.844617 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:12:40.852158 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011466 Jun 24 08:12:40.852687 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Fri Jun 24 08:12:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:12:40.863807 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-77c06ae0-7db1-4598-bfea-fdf0f817f4f0 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:12:40.871227 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-77c06ae0-7db1-4598-bfea-fdf0f817f4f0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010907 Jun 24 08:12:40.871720 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Fri Jun 24 08:12:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:16:11.579253 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:11.580315 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 24 08:16:11.580705 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:16:11.723206 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=6 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:11.839995 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4746d7dd-bbf5-48eb-84e8-55fadefa8a0b admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:11.841240 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:16:11.841240 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 24 08:16:11.844276 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4746d7dd-bbf5-48eb-84e8-55fadefa8a0b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:11.844276 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4746d7dd-bbf5-48eb-84e8-55fadefa8a0b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:11.844276 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4746d7dd-bbf5-48eb-84e8-55fadefa8a0b admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:11.844276 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-4746d7dd-bbf5-48eb-84e8-55fadefa8a0b admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:11.877130 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4746d7dd-bbf5-48eb-84e8-55fadefa8a0b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155291 Jun 24 08:16:11.877678 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 24 08:16:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:16:12.713184 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:12.714225 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 24 08:16:12.714645 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:16:12.909019 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2ae473d7-0234-4a67-bb42-9300db1f2aa2 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:12.910238 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:16:12.910238 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 24 08:16:12.911521 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-2ae473d7-0234-4a67-bb42-9300db1f2aa2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:12.911960 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-2ae473d7-0234-4a67-bb42-9300db1f2aa2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:12.912774 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-2ae473d7-0234-4a67-bb42-9300db1f2aa2 admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:12.913203 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-2ae473d7-0234-4a67-bb42-9300db1f2aa2 admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:12.934082 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2ae473d7-0234-4a67-bb42-9300db1f2aa2 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081553 Jun 24 08:16:12.934631 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 24 08:16:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:16:24.220500 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:24.221498 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 24 08:16:24.221887 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:16:24.378237 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell0:SELECT=4 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:24.378973 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell1:SELECT=4 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:24.379705 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=8 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:24.433182 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-54e380c7-62b3-4fbc-8aad-6287d65e2f12 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:24.434313 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:16:24.434313 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 24 08:16:24.435482 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-54e380c7-62b3-4fbc-8aad-6287d65e2f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:24.435992 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-54e380c7-62b3-4fbc-8aad-6287d65e2f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:24.436805 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-54e380c7-62b3-4fbc-8aad-6287d65e2f12 admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:24.437232 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-54e380c7-62b3-4fbc-8aad-6287d65e2f12 admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:24.463331 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-54e380c7-62b3-4fbc-8aad-6287d65e2f12 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089637 Jun 24 08:16:24.463877 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 24 08:16:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:16:25.295670 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: DEBUG nova.api.openstack.wsgi [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] Calling method '>' {{(pid=103742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:25.296716 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: INFO nova.api.openstack.requestlog [None req-f70c99f9-7431-429d-b69e-bf4b766edeff admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 24 08:16:25.297119 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: [pid: 103742|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 24 08:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:16:25.487629 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-059081e2-1803-4af9-bfa7-4528046f836f admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:16:25.488827 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:16:25.488827 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 24 08:16:25.490016 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-059081e2-1803-4af9-bfa7-4528046f836f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:25.490488 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-059081e2-1803-4af9-bfa7-4528046f836f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:25.491569 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-059081e2-1803-4af9-bfa7-4528046f836f admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:16:25.492222 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-059081e2-1803-4af9-bfa7-4528046f836f admin admin] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:16:25.514319 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-059081e2-1803-4af9-bfa7-4528046f836f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077397 Jun 24 08:16:25.514862 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 24 08:16:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:17:23.672614 dv-cinder-834822-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 08:17:23.673617 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: Fri Jun 24 08:17:23 2022 - graceful shutdown triggered... Jun 24 08:17:23.674062 dv-cinder-834822-6-iscsi devstack@n-api.service[103742]: Gracefully killing worker 2 (pid: 103742)... Jun 24 08:17:23.674420 dv-cinder-834822-6-iscsi devstack@n-api.service[103741]: Gracefully killing worker 1 (pid: 103741)... Jun 24 08:17:24.673807 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: worker 1 buried after 1 seconds Jun 24 08:17:24.674266 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: worker 2 buried after 1 seconds Jun 24 08:17:24.674266 dv-cinder-834822-6-iscsi devstack@n-api.service[103740]: goodbye to uWSGI. Jun 24 08:17:24.675404 dv-cinder-834822-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 08:17:24.675952 dv-cinder-834822-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 08:17:24.679127 dv-cinder-834822-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:17:24.688673 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:17:24 2022] *** Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: nodename: dv-cinder-834822-6-iscsi Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: machine: x86_64 Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: clock source: unix Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: pcre jit disabled Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: detected number of CPU cores: 4 Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: current working directory: / Jun 24 08:17:24.690692 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: your processes number limit is 47680 Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: your memory page size is 4096 bytes Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: detected max file descriptor number: 2048 Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: lock engine: pthread robust mutexes Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: thunder lock: enabled Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:17:24.691487 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:17:24.736289 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: Python main interpreter initialized at 0x562ad8d039c0 Jun 24 08:17:24.736563 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: python threads support enabled Jun 24 08:17:24.736705 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: your server socket listen backlog is limited to 100 connections Jun 24 08:17:24.736814 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:17:24.737238 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:17:24.737467 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: *** Operational MODE: preforking *** Jun 24 08:17:24.737888 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:17:24.738021 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: spawned uWSGI master process (pid: 118275) Jun 24 08:17:24.738348 dv-cinder-834822-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:17:24.739107 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: spawned uWSGI worker 1 (pid: 118295, cores: 1) Jun 24 08:17:24.739654 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: spawned uWSGI worker 2 (pid: 118296, cores: 1) Jun 24 08:17:24.739993 dv-cinder-834822-6-iscsi devstack@n-api.service[118275]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:17:25.406096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:17:25.447993 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:17:26.620438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:17:26.620438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: from cryptography.utils import int_from_bytes Jun 24 08:17:26.622292 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:17:26.622292 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: from cryptography.utils import int_from_bytes Jun 24 08:17:26.657720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:17:26.657720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: from cryptography.utils import int_from_bytes Jun 24 08:17:26.658290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:17:26.658290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: from cryptography.utils import int_from_bytes Jun 24 08:17:29.109141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:17:29.109837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:17:29.109932 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:17:29.110297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:17:29.110691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:17:29.110928 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.111261 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.111581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.111900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.112385 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.112704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.113025 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.113343 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.113671 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.113937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.114252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.114580 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-6-iscsi {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.114902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.115222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.115455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:17:29.115841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.115938 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:17:29.116023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.116219 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.116329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:17:29.116492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.116701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:17:29.116873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.116995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:17:29.117282 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.117410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.117723 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.117841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.118974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.119105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.119275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.119394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.119598 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.119714 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.119908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.120045 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.120214 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.120362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.120515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.120611 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.121446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-6-iscsi {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.121562 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-6-iscsi {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.121923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.122053 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.122236 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.122343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.122546 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.122656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.122875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123000 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123210 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123315 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.123978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.124164 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.124471 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.124581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.124786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.124904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.125110 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.125220 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.125546 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.125668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.125761 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.125859 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126035 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126156 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126344 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126449 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.126964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127377 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127821 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.127995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-6-iscsi {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.128128 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.128336 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.128478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.128677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.128798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.128991 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.129119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.129371 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.129473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.129620 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.129721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.129938 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130038 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130360 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130870 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.130975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.131176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.131280 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.131481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.131634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.131787 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.132041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.132141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.132411 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.132509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.132718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.132832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133193 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133361 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.133986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134293 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.134946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.135164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.135279 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.135486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.135621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.135843 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.135940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.136123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140391 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140391 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140836 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.140959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141349 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141459 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141813 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.141945 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.142159 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.142288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.142407 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.142526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.142656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.143326 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.143451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.143563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.143686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.143807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.143932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.144057 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.144430 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.144570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.144812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.144943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145127 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145711 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145805 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.145973 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.146995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.147100 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.147197 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.147375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.147509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.147610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.147848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148502 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148759 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.148926 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149270 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149370 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149455 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149639 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149730 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149824 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.149967 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.150110 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.150248 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.150482 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.150626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.150794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.150963 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151057 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151232 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151329 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151508 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151650 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151781 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.151882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.152010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.152116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.152784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.152903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.152999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153193 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153301 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153637 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153738 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153824 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.153917 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154285 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.154991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155224 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155321 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.155852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.156146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.156358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.156513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.156654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.156755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.156852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.156952 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.157049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.157049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.157207 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.157292 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.157461 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.157553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.157643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.157778 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.157914 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.158045 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.158182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.158318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.158447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.158577 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.158673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.158758 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.158855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.158948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.159033 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.159123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.159208 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.159299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.159391 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.159651 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.159749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.159967 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.160071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.160351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.160497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.160667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.160976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.161119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.161283 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.161605 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:17:29.161767 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.161948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.162049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.162305 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.162463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.162646 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.162743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.162974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.163092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.163328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.163665 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.163768 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.163982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.164120 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.164356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.164460 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.164697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.164802 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165028 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165174 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165445 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165655 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165756 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.165967 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.166063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.166277 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.166369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.166591 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.166692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.166919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.167022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.167237 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.167329 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.167552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.168219 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.168831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.168934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169180 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169543 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.169866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170280 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.170925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.171152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.171263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.171464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.171563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.171783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.171875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.172096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.172267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.172436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.172532 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.172748 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.172846 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173055 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173464 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173665 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173767 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.173975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.174068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.174285 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.174376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.174599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.174703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.174913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.175011 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.175222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.175371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.175563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.175666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.175921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.176025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.176163 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.176355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.176503 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.184708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.184824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.184927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185353 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.185918 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186036 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186167 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186304 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186304 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186582 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186582 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.186865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187008 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187158 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187300 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187757 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.187906 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188061 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188682 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.188971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189655 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189840 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.189934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190144 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190797 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.190939 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191125 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191248 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191785 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.191966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192267 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192593 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192905 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.192984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193403 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.193910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194285 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194493 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194585 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194670 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194766 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194859 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.194944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195035 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195127 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195225 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195310 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195647 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.195917 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196086 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196176 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196465 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196719 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.196907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197005 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197091 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197407 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197596 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.197841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.198059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.198152 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.198399 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.198497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.198717 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.198808 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.199082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.199647 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.199647 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.199900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200036 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200460 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.200919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201060 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201296 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201611 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.201912 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.202115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.202257 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.202429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.202524 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.202746 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.202881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.203073 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.203208 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.203388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.203486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.203725 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.203906 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.204981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.205112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.205293 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.205385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.205600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.205710 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.205929 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.206064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.206241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.206383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.206604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.206993 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.207113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.207260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.207433 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.207596 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.207767 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.207923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208624 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208714 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208882 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.208983 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.209196 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.209287 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.209505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.209609 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.209825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.209920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.210138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.210237 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.210446 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.210548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.210754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.210853 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.211067 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.211157 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.211379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.211481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.211691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.211790 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212015 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212365 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212475 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212674 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212764 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.212980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.213117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.213304 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.213406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.213616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.213716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.213922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.214013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.214228 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.214351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.215072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.215646 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.215745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.215839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.215940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.216036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.216122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.216239 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.218872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.218996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.219124 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.219234 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.219455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.219581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.219719 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.219881 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220036 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220374 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220679 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.220974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221123 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.221956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222258 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222397 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222819 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.222996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223188 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223283 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.223996 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224273 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224520 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.224933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225153 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225502 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225794 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.225925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.226108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.226234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.226433 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.226562 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.226724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.226900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.227030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.227245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.227364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.227474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.227777 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.227903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.228014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.229038 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.229309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.229568 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.229774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.229926 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.230069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.231119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.231371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.231608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.231776 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.232023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.232289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.232542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.232786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.233034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.233207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.233511 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.233765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.233983 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.234150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.234307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.234463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.234619 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.234776 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.234934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.235083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.235238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.235386 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.235552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.235709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.235886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.236071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.236276 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.236442 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.236597 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.236755 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.236755 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.237045 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.237194 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.237347 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.237507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.237736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.237736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.238029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.238176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.238330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.239137 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.239315 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.239490 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.239652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.239810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.239965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.240122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.240321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.240481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.240629 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.240881 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241501 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241655 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.241968 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.242126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.242274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.242432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.242579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.242726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.242873 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243029 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243489 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243647 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243796 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.243952 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.244102 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.244321 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.244321 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.244611 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.244771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.244920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.245075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.245222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.245375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.245523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.246291 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.246883 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.247056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.247216 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.247387 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.247544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.247702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.247857 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.248006 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.248155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.248338 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.248488 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.248754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.249072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.249239 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.249388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.249535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.249708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.249864 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.250944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.251093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.251239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.251387 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.251546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.251713 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.251862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252172 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252382 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252547 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.252997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.253151 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.253307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.253456 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.253603 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.253766 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.253913 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254059 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254230 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.254974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.255129 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.255276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.255429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.255591 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.255781 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.255944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.256210 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.256467 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.256632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.256873 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.257022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.257022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.257022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.257718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.257969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.258120 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.258284 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.258665 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.259003 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.259314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.259471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.259619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.259917 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.260076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.260246 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.260672 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.260838 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.260995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.261320 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.262327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.262839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.262994 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.263142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.263298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.263457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.263607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.263761 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.263911 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.264058 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.264266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.264440 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.264599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.264759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.264915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.265979 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.266126 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.266286 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.266444 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.266592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.266756 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.266912 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267838 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.267994 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.268150 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.268319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.268478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.268644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.268800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.269048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.269205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.269205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.269662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.269810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.269965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.270126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.270282 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.270430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.270577 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.270724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.270882 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271042 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271191 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271346 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271649 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.271965 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.272120 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.272307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.272469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.272618 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.272774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.272940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.273088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.273279 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.273437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.273585 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.273741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.273897 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274059 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274219 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274366 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274816 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.274974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.275121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.275275 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.275483 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.275641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.275796 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.275943 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.276090 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.276549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.276716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.276874 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.276874 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.278020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.278020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.278504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.278762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.279027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.279345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.279847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.280182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.280452 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.280613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.280762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.280909 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.281063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.281230 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.281465 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.281617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.281767 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.281922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282070 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282827 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.282827 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.283107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.283274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.283421 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.283568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.283722 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.283878 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284212 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284681 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.284985 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.285133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.285292 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.285292 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.285572 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.285727 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.285884 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286032 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286343 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286491 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286638 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.286800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.287099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.287255 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.287403 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.287558 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.287720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.287868 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.288022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.288475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.288649 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.288815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.288964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.289121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.289287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.289523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.289846 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290020 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290824 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.290975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.291122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.291354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.291521 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.291680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.291680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.291973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.292121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.292291 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.292451 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.292656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.292856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.293501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.293663 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.293820 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.293969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.294128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.294307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.294459 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.294607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.294763 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.294920 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295225 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295374 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295838 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.295986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.296133 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.296334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.296496 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.296694 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.296853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.297002 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.297149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.297465 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.297702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.297866 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.298114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.298278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.298597 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.298756 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.299077 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.299077 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.299470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.299802 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.300217 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.300386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.300643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.300990 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.301242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.301398 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.302005 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.302169 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.302414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.302683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.302942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.302942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.303492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.303650 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.303800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.303970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.304120 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.304316 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.304478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.304636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.304799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.304960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.305108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.305262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.305411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.305411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.305705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.305854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.306008 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.306171 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.306319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.306467 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.306693 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.306844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.307928 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.308084 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.308772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.308946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.309669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.309848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.310247 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.310430 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.310581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.310749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.310906 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311213 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311361 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311508 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311818 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.311973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.312128 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.312335 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.312509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.312668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.312829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.312984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.313140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.313289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.313449 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.313610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.313759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.313905 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.314053 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.314206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.314375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.314535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.314697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.314855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315156 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315314 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315771 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.315918 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.316064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.316236 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.316401 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.316550 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.316697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.316844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317008 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317763 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.317936 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.318087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.318234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.318234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.318542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.318697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.318858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.319014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.319170 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.319326 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.319539 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.319787 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.319955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.320558 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.320872 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.321054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.321325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.321485 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.321643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.321643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.322181 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.322432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.322590 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.322860 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.323152 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.323325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.323481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.323594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.323705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.323824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.324977 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.325205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.325327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.327835 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.328014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.328166 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.328352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.328502 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.328677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.328840 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.329018 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.329170 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.329323 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.329537 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.329703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.329853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.330014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.330182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.330417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.330753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.330753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.331064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.331225 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.331382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.331539 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.331722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.331873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.332049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.332227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.332394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.332548 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.332705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.332862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333336 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333646 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333809 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.333966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.334132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.334290 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.334464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.334623 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.334780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.334937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.335086 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.335245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.335394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.335542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.335735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.335914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.336173 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.336383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.336544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.336704 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.336854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337325 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.337937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.338093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.338249 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.338399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.338556 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.338704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.338852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.339009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.339175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.339333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.340040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.340456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.341268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.341432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.341593 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.341757 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.341907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342219 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342858 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.342858 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.343155 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.343155 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.343615 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.343784 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.344016 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.344179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.344458 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.344609 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.344937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.345192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.345436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.345693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.345693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.346092 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.346256 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.346414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.346728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.346969 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.347270 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.347431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.347590 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.347746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.348015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.348324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.348475 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.348749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.348907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.349056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.349378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.349624 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.349779 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.350115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.350271 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.350429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.350746 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.351024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.351613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.351786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.351935 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.352093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.352299 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.352455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.352623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.352791 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.352963 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.353120 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.353276 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.353432 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.353610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.353610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.353902 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354526 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354681 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354830 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.354977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.355389 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.356152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.356356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.356508 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.356665 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.356822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.356978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.357137 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.357303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.357457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.357606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.357754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.357922 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358843 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.358993 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.359149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.359298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.359454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.359602 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.359759 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.359908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.360063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.360269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.360428 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.360428 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.360734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.360884 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.361032 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.361187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.361437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.361791 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.361949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.362106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.362262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.362418 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.362578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.362741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.362891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363203 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363353 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363507 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363670 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363819 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.363968 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.364116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.364286 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.364448 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.364615 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.364771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.364927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.365076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.365231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.365389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.365546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.365695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.365851 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366000 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.366915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.367996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.368240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.368505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.368656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.368916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.369071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.369381 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.369538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.369816 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.369816 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.370167 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.370317 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.370474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.370623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.372062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.372267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.372425 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.372575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.372733 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.372891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373200 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373349 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373840 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.373996 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.374371 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.374570 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.374826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.375096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.375261 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.375548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.375704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.375853 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.376307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.376528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.376774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.376941 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.377091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.377383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.377537 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.377698 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.377855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378623 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.378927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.379075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.379333 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.379614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.379769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.379918 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380074 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.380999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.381147 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.381289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.381462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.381620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.381771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.382186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.382357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.382357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.382651 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.382800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.382955 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.383111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.383273 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.383429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.383579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.383746 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.383895 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.384051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.384406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.384570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.384570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.384867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.385016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.385568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.385722 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.385878 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.386027 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.386186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.386392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.386806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.387363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.387526 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.387678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.387837 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.387997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.387997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.388352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.388505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.388654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.388811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.388983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.388983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.389283 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.389283 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.389715 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.389873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390186 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390482 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390630 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.390954 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.391103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.391258 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.391415 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.391564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.391722 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.391872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.392045 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.392543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.392713 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.392864 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393029 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393664 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.393987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.394145 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.394294 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.394442 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.394590 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.394753 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.394910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395067 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395228 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395377 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.395986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.396141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.396329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.396479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.396651 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.396810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.396967 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.397124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.397290 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.397447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.397610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.397759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.397907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398221 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398687 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398843 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.398991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.399149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.399307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.399464 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.399709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.399874 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.399874 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.400164 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.400373 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.400526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.400675 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.400831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.400980 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.401140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.401308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.401463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.401611 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.401766 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.401915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.403218 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.403218 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.403535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.403693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.403849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.403999 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.404162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.404388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.404552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.404701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.404858 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.405179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.406321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.407454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:17:29.408638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:17:29.440643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO dbcounter [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Registered counter for database nova_api Jun 24 08:17:29.450278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO dbcounter [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Registered counter for database nova_api Jun 24 08:17:29.461615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_db.sqlalchemy.engines [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.468368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writer thread running {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.470740 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_db.sqlalchemy.engines [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.477524 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writer thread running {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.525860 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.context [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),081d19cb-2fd5-4e7c-8144-7f74f0537b29(cell1) {{(pid=118295) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:17:29.530224 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:17:29.531828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:17:29.532645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:17:29.534578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:17:29.535253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.context [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),081d19cb-2fd5-4e7c-8144-7f74f0537b29(cell1) {{(pid=118296) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:17:29.536588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO dbcounter [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Registered counter for database nova_cell0 Jun 24 08:17:29.539468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:17:29.540588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO dbcounter [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Registered counter for database nova_cell1 Jun 24 08:17:29.541184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:17:29.542115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:17:29.544227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:17:29.546218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO dbcounter [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Registered counter for database nova_cell0 Jun 24 08:17:29.547995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_db.sqlalchemy.engines [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.549326 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_db.sqlalchemy.engines [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.550889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO dbcounter [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Registered counter for database nova_cell1 Jun 24 08:17:29.555982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writer thread running {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.558096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writer thread running {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.559076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_db.sqlalchemy.engines [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.561327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_db.sqlalchemy.engines [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.568046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writer thread running {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.569640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writer thread running {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.707310 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO dbcounter [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Registered counter for database nova_cell0 Jun 24 08:17:29.713911 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_db.sqlalchemy.engines [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.719130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writer thread running {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:29.738628 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO dbcounter [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Registered counter for database nova_cell0 Jun 24 08:17:29.745233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_db.sqlalchemy.engines [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:17:29.749700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writer thread running {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:17:30.040497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: WARNING keystonemiddleware.auth_token [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:17:30.047993 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: WARNING keystonemiddleware.auth_token [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:17:30.081002 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: WARNING keystonemiddleware.auth_token [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:17:30.088257 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: WARNING keystonemiddleware.auth_token [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:17:30.394664 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: WARNING keystonemiddleware.auth_token [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:17:30.400631 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: WARNING keystonemiddleware.auth_token [None req-b7cb851f-5664-4204-950f-a38297c9ffe8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:17:30.406367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ad8d039c0 pid: 118295 (default app) Jun 24 08:17:30.435513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: WARNING keystonemiddleware.auth_token [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:17:30.441539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: WARNING keystonemiddleware.auth_token [None req-8386b270-62df-4117-a0ae-ee7bc16b6718 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:17:30.446937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ad8d039c0 pid: 118296 (default app) Jun 24 08:18:17.126987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6d5d5785-562a-451b-945f-13eea9bbb16e tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f149826c280>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:17.164169 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:17.166360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:17.166463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:17.167735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:17.872928 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6d5d5785-562a-451b-945f-13eea9bbb16e tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9a0bfdee-eacd-4f64-86e4-e2c7ed4bc9e5" status: 200 len: 351 microversion: 2.1 time: 1.130159 Jun 24 08:18:17.880991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 1/1] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:18:16 2022] GET /compute/v2.1/os-volumes/9a0bfdee-eacd-4f64-86e4-e2c7ed4bc9e5 => generated 351 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:22.013240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8b8a356c-dcc8-4cc6-808b-ab89d225ad13 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f149826b280>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:22.082518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:22.084369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:22.085643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:22.087683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:22.873581 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8b8a356c-dcc8-4cc6-808b-ab89d225ad13 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/35f6eaaf-ca54-4a25-af9e-2ff9b72e8e77" status: 200 len: 351 microversion: 2.1 time: 1.510712 Jun 24 08:18:22.874357 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:18:21 2022] GET /compute/v2.1/os-volumes/35f6eaaf-ca54-4a25-af9e-2ff9b72e8e77 => generated 351 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:25.050872 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-447bc12a-ee7a-4196-80d7-3bf03ec6c528 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f14980c1790>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:25.166061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-447bc12a-ee7a-4196-80d7-3bf03ec6c528 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f940a824-00da-4a81-8beb-1cafc9f1f2c9" status: 200 len: 350 microversion: 2.1 time: 0.119477 Jun 24 08:18:25.166194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:18:25 2022] GET /compute/v2.1/os-volumes/f940a824-00da-4a81-8beb-1cafc9f1f2c9 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:25.179635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c3a2c4b4-23a1-40b3-833b-e2b9b0835f47 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f14980c2280>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:25.594919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c3a2c4b4-23a1-40b3-833b-e2b9b0835f47 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.419492 Jun 24 08:18:25.607643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jun 24 08:18:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:25.616644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-16c6cbd5-45b0-424b-bb59-fc2dbabc76d8 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f14980c14c0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:25.834750 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-16c6cbd5-45b0-424b-bb59-fc2dbabc76d8 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.230464 Jun 24 08:18:25.835601 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1148 bytes} [Fri Jun 24 08:18:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:25.848683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e828ade2-491d-44a0-a1da-bc17a7689e66 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f14980c2d30>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:26.133384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e828ade2-491d-44a0-a1da-bc17a7689e66 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.288671 Jun 24 08:18:26.141394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jun 24 08:18:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:26.145933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d35fc0ce-281b-4b96-9207-1ba5f0e0de7a tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f149808b820>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:26.285944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d35fc0ce-281b-4b96-9207-1ba5f0e0de7a tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.143688 Jun 24 08:18:26.287140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1166 bytes} [Fri Jun 24 08:18:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:26.300040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-74d3bc71-e963-4fac-b507-c3d2dca9015c tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f149808ba60>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:26.494352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-74d3bc71-e963-4fac-b507-c3d2dca9015c tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.198736 Jun 24 08:18:26.494922 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1169 bytes} [Fri Jun 24 08:18:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:26.509220 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5746362b-a4a5-4853-9f3d-82df054648b4 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f149808b700>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:26.735427 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5746362b-a4a5-4853-9f3d-82df054648b4 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.230133 Jun 24 08:18:26.743770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1154 bytes} [Fri Jun 24 08:18:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:26.749069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f2add4d7-506f-412e-98aa-ef5c26473724 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f14989e3c10>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:27.005024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f2add4d7-506f-412e-98aa-ef5c26473724 tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259882 Jun 24 08:18:27.005950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1187 bytes} [Fri Jun 24 08:18:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:27.018366 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-67cd8f7f-f5fe-47ea-915c-0bdb9f65031e tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] Calling method '.version_select at 0x7f1498089430>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:27.133963 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1773022200", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "networks": [{"uuid": "d92a1584-eab7-4ac8-a344-67821b0aca95"}]}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:27.222736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-67cd8f7f-f5fe-47ea-915c-0bdb9f65031e tempest-VolumesTestJSON-1924660744 tempest-VolumesTestJSON-1924660744-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.208549 Jun 24 08:18:27.223739 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 7/11] 10.222.0.42 () {58 vars in 1154 bytes} [Fri Jun 24 08:18:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:27.337023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] validate_networks() for [('d92a1584-eab7-4ac8-a344-67821b0aca95', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:18:29.952886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f94a005c-fa46-4678-b21f-064eb8c2a8d2 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: .version_select at 0x7f14980c2dc0>, body: {"keypair": {"name": "tempest-keypair-1233394706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv8qoVSWqAqhJZrr0jicCkKVVUGGS2NCyRaSPIHZx3a0xvew+VZZTRamBDoxsH4QyEVDNIDf8HUP4rDVOHKCHLxIb4ck2sNJUR+fV5vTgLlIvnBEQYFN95PgDIB4RsZtA=="}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:30.063023 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-f94a005c-fa46-4678-b21f-064eb8c2a8d2 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:30.077027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-f94a005c-fa46-4678-b21f-064eb8c2a8d2 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:30.166705 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:18:30.167426 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:18:30.168135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:18:30.169447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:18:30.170040 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:18:30.211746 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:30.214158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:30.218285 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:30.222747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:30.347099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Getting quotas for project 14f7d7e0a5614243974c4c44ec466b14. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:30.373892 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f94a005c-fa46-4678-b21f-064eb8c2a8d2 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.773664 Jun 24 08:18:30.376118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Getting quotas for user f611b3dde95e44c7931445bb3ef1f59a and project 14f7d7e0a5614243974c4c44ec466b14. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:30.376897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 8/12] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:18:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:30.438253 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:18:30.443358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:18:30.792761 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4b119d45-012a-4b13-959d-88aadf7263fc tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.289499 Jun 24 08:18:30.793568 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 5/13] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:18:30.817127 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2025994c-b466-4dc1-b306-a4b9335b008e tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:30.817778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2025994c-b466-4dc1-b306-a4b9335b008e tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:31.061978 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2025994c-b466-4dc1-b306-a4b9335b008e tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:31.090890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2025994c-b466-4dc1-b306-a4b9335b008e tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1215 microversion: 2.1 time: 0.290967 Jun 24 08:18:31.093172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 6/14] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:30 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:31.499245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-45eeb720-d2c2-406e-aa5e-cfa19a16933f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: .version_select at 0x7f1497fe7280>, body: {"keypair": {"name": "tempest-keypair-2010666935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT0KtsCLQOHWLyCIIp7faS4tpa1JB9hfCg4FlYIMNthUavlflBZLTFFxiOMux00I9bAqnNfux3ikxR0UEySXXeWUNw1ZPscH9U2sP7Mx6xxWRdpdFQbmYISz7kYrnIYEA=="}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:31.538441 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-45eeb720-d2c2-406e-aa5e-cfa19a16933f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for project dc30155e50104560b2cd8d95f3e534a6. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:31.546735 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-45eeb720-d2c2-406e-aa5e-cfa19a16933f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for user b3345cc7b11246358bb1f5babd054e60 and project dc30155e50104560b2cd8d95f3e534a6. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:31.719635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-45eeb720-d2c2-406e-aa5e-cfa19a16933f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.033081 Jun 24 08:18:31.720404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 9/15] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:18:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:32.113817 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c2f2a5c5-2209-4b4e-b4ae-d5d2fc7473b2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:32.119613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c2f2a5c5-2209-4b4e-b4ae-d5d2fc7473b2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:32.251180 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c2f2a5c5-2209-4b4e-b4ae-d5d2fc7473b2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:32.259922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c2f2a5c5-2209-4b4e-b4ae-d5d2fc7473b2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1215 microversion: 2.1 time: 0.152569 Jun 24 08:18:32.260732 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 7/16] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:32 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:33.280463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-22cdb62a-ef72-4ef7-8541-660182ba31e8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:33.281487 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-22cdb62a-ef72-4ef7-8541-660182ba31e8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:33.412094 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-22cdb62a-ef72-4ef7-8541-660182ba31e8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:33.430234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-22cdb62a-ef72-4ef7-8541-660182ba31e8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1215 microversion: 2.1 time: 0.156236 Jun 24 08:18:33.436260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:33 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:34.394720 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1072447894", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:34.432307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8e3cc490-e524-44a0-a418-d7eb2523fa3c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'create', calling method: .version_select at 0x7f1496f48a60>, body: {"keypair": {"name": "tempest-keypair-1306386710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFMm4hViEPj+nL4Ygnjcsgq4zxOTDSMoOCVq9zq+uL+ZYTYCSOiu8FH+9L8dgAeOStYv4Og3AsQRrakC1+Snzauv8mi5UjieJvaIG3KJPMVkvL0BJnM5Ur2Ha3CaORBw=="}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:34.567177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-8e3cc490-e524-44a0-a418-d7eb2523fa3c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for project e1244423396f45beb9124e6d04e0381b. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:34.581600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-8e3cc490-e524-44a0-a418-d7eb2523fa3c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for user 6935dece64c14ab28be74275d43f07ab and project e1244423396f45beb9124e6d04e0381b. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:34.658854 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] validate_networks() for [('99d769cf-78c9-4625-a069-73c6a05c7529', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:18:34.741251 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8e3cc490-e524-44a0-a418-d7eb2523fa3c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.121316 Jun 24 08:18:34.741861 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 8/18] 10.222.0.42 () {62 vars in 1199 bytes} [Fri Jun 24 08:18:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 08:18:34.770700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-10ffc285-ac47-49ee-af93-b5bc9c52a1fb tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:34.771314 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-10ffc285-ac47-49ee-af93-b5bc9c52a1fb tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:34.945102 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-10ffc285-ac47-49ee-af93-b5bc9c52a1fb tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:34.956404 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-10ffc285-ac47-49ee-af93-b5bc9c52a1fb tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1215 microversion: 2.1 time: 0.213285 Jun 24 08:18:34.961166 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:34 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:35.976588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:35.978020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:35.986138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:35.987219 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:35.988159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:35.988782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:36.245594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:36.269377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e7c84e8f-1912-44e1-b2dc-19e179b4b7c1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1211 microversion: 2.1 time: 0.297884 Jun 24 08:18:36.269854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 10/20] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:35 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1211 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:37.098204 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-529234588", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7"}], "security_groups": [{"name": "tempest-securitygroup--2019197546"}], "key_name": "tempest-keypair-1233394706", "user_data": "}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:37.465932 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] validate_networks() for [('be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:18:38.978810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:18:38.980001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:18:38.980529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:18:38.981209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:18:38.981848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:18:39.005930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:39.009537 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:39.010918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:39.013470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:39.111369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:39.130085 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for user 5ebbd67cca66411ea52e4b92478564cf and project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:39.154081 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:18:39.157454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:18:39.458911 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b7119e36-fc45-4470-b682-953a12b224bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.737498 Jun 24 08:18:39.464612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 11/21] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:18:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 5739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:18:39.473457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:39.474093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:39.493544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:39.494054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:39.494928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:39.495422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:39.807670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:18:39.808534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:18:39.809715 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:18:39.810271 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:18:39.810841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:18:39.829583 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:39.830089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:39.830838 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:39.836039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:39.919025 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:39.934604 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:39.994282 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:18:40.000269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:18:40.284183 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:40.330782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-75c383d5-5f5f-4a4f-83b2-f9a1b341815c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.213873 Jun 24 08:18:40.330782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 11/22] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:18:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:18:40.344514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-193314078", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c76a2a8e-3a64-4d93-aa9d-693f42506f96"}], "security_groups": [{"name": "tempest-securitygroup--302604831"}], "key_name": "tempest-keypair-2010666935", "user_data": "}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:40.346405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6974e315-a983-4234-9736-56eae3455e4b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1273 microversion: 2.1 time: 0.885100 Jun 24 08:18:40.358914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:39 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1273 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:40.386884 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9f749e7f-6c29-4c3b-80ba-5af48f5ad333 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:40.390390 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9f749e7f-6c29-4c3b-80ba-5af48f5ad333 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:40.792889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9f749e7f-6c29-4c3b-80ba-5af48f5ad333 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:40.810286 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9f749e7f-6c29-4c3b-80ba-5af48f5ad333 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1222 microversion: 2.1 time: 0.449969 Jun 24 08:18:40.810697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:40 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1222 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:40.858702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-084665e3-2780-4456-bccf-3ed3bc7ced6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:40.860725 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-084665e3-2780-4456-bccf-3ed3bc7ced6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:41.117298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-084665e3-2780-4456-bccf-3ed3bc7ced6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:41.129456 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-084665e3-2780-4456-bccf-3ed3bc7ced6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1241 microversion: 2.1 time: 0.315537 Jun 24 08:18:41.132685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:40 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1241 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:41.170146 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1426570057", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c50a71f-1e65-4e5e-ae0f-e6f8fa025675"}], "security_groups": [{"name": "tempest-securitygroup--1851054325"}], "key_name": "tempest-keypair-1306386710", "user_data": "}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:41.307175 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] validate_networks() for [('c76a2a8e-3a64-4d93-aa9d-693f42506f96', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:18:41.837069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] validate_networks() for [('4c50a71f-1e65-4e5e-ae0f-e6f8fa025675', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:18:43.297216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:18:43.297761 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:18:43.298147 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:18:43.298605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:18:43.299157 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:18:43.309430 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:18:43.309944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:18:43.310353 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:18:43.310761 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:18:43.311175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:18:43.347055 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:43.350857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:43.350857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:43.353919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:43.354968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:43.360107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:43.361628 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:43.367691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:43.419308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for project dc30155e50104560b2cd8d95f3e534a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:43.431344 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for user b3345cc7b11246358bb1f5babd054e60 and project dc30155e50104560b2cd8d95f3e534a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:43.431486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for project e1244423396f45beb9124e6d04e0381b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:43.439275 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for user 6935dece64c14ab28be74275d43f07ab and project e1244423396f45beb9124e6d04e0381b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:43.444791 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:18:43.446944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:18:43.455939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:18:43.461612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:18:43.719697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-167ed89f-3c3f-4e0e-9535-acdba7a5ad91 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.396419 Jun 24 08:18:43.722893 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 12/26] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:18:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 3400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:18:43.731817 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-703065338", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:43.743561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9eec504e-2911-49f6-afe7-d91d48cadb00 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.603708 Jun 24 08:18:43.749583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 15/27] 10.222.0.42 () {62 vars in 1187 bytes} [Fri Jun 24 08:18:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 2616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:18:43.811627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:43.813663 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:43.880231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:43.880734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:43.890529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:43.894332 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:44.022335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] validate_networks() for [('99d769cf-78c9-4625-a069-73c6a05c7529', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:18:44.533662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:44.556582 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ee68a633-6e77-4836-afd4-c1f39a79b308 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.800411 Jun 24 08:18:44.557408 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 16/28] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:43 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:44.574009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:44.574009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:44.591709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:44.592480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:44.595769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:44.596713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:44.830073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:44.839825 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1de53bba-8519-491f-b23f-ede7cc37db76 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1293 microversion: 2.1 time: 0.279863 Jun 24 08:18:44.841121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 17/29] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:44 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1293 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:44.875248 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-005aec2e-aead-48cb-8c1c-857fc94efeed tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:44.876091 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-005aec2e-aead-48cb-8c1c-857fc94efeed tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:45.203107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-005aec2e-aead-48cb-8c1c-857fc94efeed tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:45.218569 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-005aec2e-aead-48cb-8c1c-857fc94efeed tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1237 microversion: 2.1 time: 0.364213 Jun 24 08:18:45.231388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 18/30] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:44 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1237 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:45.245687 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-95b77b85-b77c-47e8-abc7-9f54728be8a9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:45.249899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-95b77b85-b77c-47e8-abc7-9f54728be8a9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:45.424390 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95b77b85-b77c-47e8-abc7-9f54728be8a9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:45.440330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95b77b85-b77c-47e8-abc7-9f54728be8a9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:45.445018 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95b77b85-b77c-47e8-abc7-9f54728be8a9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:45.451573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-95b77b85-b77c-47e8-abc7-9f54728be8a9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1282 microversion: 2.20 time: 0.218734 Jun 24 08:18:45.463750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 19/31] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:45 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:45.581773 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:45.584619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:45.594385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:45.604470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:45.606320 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:45.607549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:46.523282 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:46.538976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-14e6bfad-7667-4eb6-ab74-1298426bbd07 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.967133 Jun 24 08:18:46.555206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 20/32] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:45 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:46.592730 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:46.624765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:46.658206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:46.659620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:46.660975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:46.661683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:46.688431 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:18:46.694470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:18:46.694470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:18:46.694470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:18:46.694470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:18:46.709144 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:46.710080 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:46.711183 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:46.711836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:46.736189 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:18:46.746127 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for user 5ebbd67cca66411ea52e4b92478564cf and project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:18:46.756889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:18:46.760159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:18:46.812613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:46.844344 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ed8db8fd-311a-4896-b5b0-44fa9346b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1299 microversion: 2.1 time: 0.280702 Jun 24 08:18:46.844344 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 21/33] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:46 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1299 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:46.874266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:46.875308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:46.897232 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:46.899453 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:46.902244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:46.904393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:47.117804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-afb434e6-0c5a-4bcc-86c9-6c502c344ee0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.386869 Jun 24 08:18:47.120268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 13/34] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:18:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:18:47.134328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:47.138487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:47.189389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:47.203701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:47.205432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:47.207250 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:47.283013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:47.295130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dee55f2e-3469-413c-8e89-1252a120f5bc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1233 microversion: 2.1 time: 0.448371 Jun 24 08:18:47.300071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 22/35] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:46 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1233 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:47.334079 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-078d106c-86af-4b03-b302-cdb49c03a898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:47.334878 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-078d106c-86af-4b03-b302-cdb49c03a898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:47.576124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:47.629695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:47.638172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:47.641605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1f2fd483-5b96-4dd7-9ea5-df919f0cda3a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1278 microversion: 2.20 time: 0.518115 Jun 24 08:18:47.653092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 14/36] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:47 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1278 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:47.690203 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:47.690915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:47.712037 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:47.716811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:47.717827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:47.718278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:47.718433 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-078d106c-86af-4b03-b302-cdb49c03a898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:47.725908 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-078d106c-86af-4b03-b302-cdb49c03a898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1221 microversion: 2.1 time: 0.410610 Jun 24 08:18:47.732959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 23/37] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:47 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1221 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:47.857964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:47.858592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:47.868028 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:47.868506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:47.883356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:47.884241 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:48.209988 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:48.230178 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5bb9789e-4bd6-4e53-aec1-b200cc04ab2b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1299 microversion: 2.1 time: 0.377684 Jun 24 08:18:48.241547 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 24/38] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:47 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1299 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:48.313920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:48.314847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:48.322155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:48.342847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:48.349416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:48.352792 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:48.851404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:48.861102 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d2ebd6f6-9bf1-46c8-a0a2-4dcb642811be tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1289 microversion: 2.1 time: 0.551155 Jun 24 08:18:48.868503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 25/39] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:48 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1289 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:48.878193 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:48.881201 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:48.893201 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:48.898462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:48.903447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:48.909021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:48.910331 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:49.473248 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:49.493345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:49.495037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:49.509261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-11ecd97d-0aab-4551-a48d-8f380ec9adac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1334 microversion: 2.20 time: 0.639434 Jun 24 08:18:49.522063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 26/40] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:48 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1334 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:49.528615 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:49.529674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:49.544359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:49.545249 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:49.546346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:49.546937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:49.627945 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:49.644046 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d2bf7707-c9be-4cd6-93a9-ec21ecc97b7c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 1.979863 Jun 24 08:18:49.644994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 15/41] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:47 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:49.660575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:49.661417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:49.666067 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:49.674193 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:49.676655 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:49.678942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:49.681429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.054254 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.070426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d46e7d38-7cfe-4c2c-9ec2-90f81caab064 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1217 microversion: 2.1 time: 0.546929 Jun 24 08:18:50.071962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.087241 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 27/42] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:49 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1217 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:50.095445 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6f68a308-9f56-444b-9cd3-d7cbf7621d84 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1299 microversion: 2.1 time: 0.449190 Jun 24 08:18:50.100323 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 16/43] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:49 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1299 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:50.135117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:50.135739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:50.160619 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.161369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.162399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.163161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.297322 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-864812ec-6882-47ca-b433-76d5802ec914 req-fcc5d4c1-92a3-4fd7-8bbb-bb7c830a0917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ce4c46-0c8a-4917-8efb-30706cac089c", "tag": "823e7cca-f746-4e4d-acb7-1d8522ad4750"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:50.339261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-864812ec-6882-47ca-b433-76d5802ec914 req-fcc5d4c1-92a3-4fd7-8bbb-bb7c830a0917 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.340041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-864812ec-6882-47ca-b433-76d5802ec914 req-fcc5d4c1-92a3-4fd7-8bbb-bb7c830a0917 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.376375 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-864812ec-6882-47ca-b433-76d5802ec914 req-fcc5d4c1-92a3-4fd7-8bbb-bb7c830a0917 service nova] Creating event network-changed:823e7cca-f746-4e4d-acb7-1d8522ad4750 for instance 02ce4c46-0c8a-4917-8efb-30706cac089c on hv-cinder-83482 Jun 24 08:18:50.377263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-864812ec-6882-47ca-b433-76d5802ec914 req-fcc5d4c1-92a3-4fd7-8bbb-bb7c830a0917 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:18:50.378717 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36df910d-778b-47d0-9e29-98747835e022 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.379346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36df910d-778b-47d0-9e29-98747835e022 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.380310 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36df910d-778b-47d0-9e29-98747835e022 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.382266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36df910d-778b-47d0-9e29-98747835e022 None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.404811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.compute.rpcapi [None req-36df910d-778b-47d0-9e29-98747835e022 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:18:50.406112 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36df910d-778b-47d0-9e29-98747835e022 None None] Releasing lock "compute-rpcapi-router" {{(pid=118296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:18:50.442261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-36df910d-778b-47d0-9e29-98747835e022 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353255 Jun 24 08:18:50.443158 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 28/44] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:50.530041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:50.530817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:50.539835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.540256 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.541025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.541466 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.590950 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.613728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6d5324fe-5d8e-471f-ad71-a0980b209e18 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1295 microversion: 2.1 time: 0.509983 Jun 24 08:18:50.632113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 17/45] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:50 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1295 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:50.665174 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:50.666140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:50.677949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.678699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.679666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:50.683282 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:50.687143 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.701521 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.703171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.704316 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5f825358-e34b-41b0-b6b0-23012947455a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1340 microversion: 2.20 time: 0.179413 Jun 24 08:18:50.704879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 29/46] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:50 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1340 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:50.917773 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:50.927392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b7f71192-c3d8-4e8c-8665-a44e949c19d2 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.269041 Jun 24 08:18:50.929569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 18/47] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:50 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:51.103041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:51.105435 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:51.119183 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:51.120400 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:51.132880 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:51.133640 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:51.134800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:51.135592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:51.136809 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:51.141316 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:51.147266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:51.151970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:51.660748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:51.673086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-20abb619-08cf-4e62-810a-789bfd7b91ce tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1273 microversion: 2.1 time: 0.582586 Jun 24 08:18:51.681048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 30/48] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:51 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1273 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:51.684427 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:51.690698 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:51.722998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:51.731580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:51.744165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:51.744935 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.022447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.030635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ab060b34-ee8b-4d96-a262-d423c7d9cb32 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1295 microversion: 2.1 time: 0.355598 Jun 24 08:18:52.039104 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 31/49] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:51 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1295 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:52.045636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:52.046255 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:52.070555 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:52.071009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.071797 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:52.072247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.091070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.106460 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ab58f4a9-ab8b-4b6c-ac71-6d82fc4f222c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.992050 Jun 24 08:18:52.113176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 19/50] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:51 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:52.123853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:52.129103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:52.140556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:52.140556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.140556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:52.140556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.221886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.234636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.236188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.237398 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1f90c134-50ef-4fff-8529-19c5809e207b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1340 microversion: 2.20 time: 0.197155 Jun 24 08:18:52.241712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 32/51] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:52 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:52.362562 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.372918 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c38b3c64-adee-403e-ad48-04873346de36 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.258386 Jun 24 08:18:52.382450 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 20/52] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:52 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:52.690801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:52.691406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:52.700223 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:52.700671 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.701448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:52.706741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:52.799069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:52.806874 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b24a0d30-072b-4870-8642-fb55756509c5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1279 microversion: 2.1 time: 0.119844 Jun 24 08:18:52.807445 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 33/53] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:52 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:53.048239 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:53.049296 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:53.061513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.067567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.068672 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.069261 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.126282 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:53.126895 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:53.141188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.141639 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.142526 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.144334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.179303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:53.477322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:53.495721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b2ad9690-1055-48fd-bea1-79d8e8a2b04a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.451511 Jun 24 08:18:53.497539 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 21/54] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:53 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:53.502980 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:53.504285 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:53.505290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:53.510576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5d8ebc51-0efe-40b6-94eb-78551eab67bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.388452 Jun 24 08:18:53.516661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.517351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.517699 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 34/55] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:53 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:53.518442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.519025 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.532738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:53.541574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:53.560598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.562980 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.562980 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.562980 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.894092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:53.903031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:53.904874 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:53.906088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-886c9244-cce8-4a26-87e8-3428e9708bfc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.407418 Jun 24 08:18:53.906208 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:53.916486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 22/56] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:53 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:53.916486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:53.917936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:53.932589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9a0627a0-dbe0-4049-9bdd-0c4b5b51338d tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.413690 Jun 24 08:18:53.933184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 35/57] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:53 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:53.939174 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.939849 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:53.940929 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:53.941543 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.070595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:54.079088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0ded9076-6f80-4cbc-a1c1-c75770ece571 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1279 microversion: 2.1 time: 0.170818 Jun 24 08:18:54.079824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 23/58] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:53 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:54.192829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-10c0f296-eff9-452f-94bf-9e3a0b4cfd76 req-5920b458-bd3f-432e-989d-18e2bd2b8849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4879e55-2bc5-4df2-b495-a4ba5f0c98fa", "tag": "5f99fb72-376e-4446-ad42-3753371001b5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:54.213881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-10c0f296-eff9-452f-94bf-9e3a0b4cfd76 req-5920b458-bd3f-432e-989d-18e2bd2b8849 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.214676 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-10c0f296-eff9-452f-94bf-9e3a0b4cfd76 req-5920b458-bd3f-432e-989d-18e2bd2b8849 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.226864 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-10c0f296-eff9-452f-94bf-9e3a0b4cfd76 req-5920b458-bd3f-432e-989d-18e2bd2b8849 service nova] Creating event network-changed:5f99fb72-376e-4446-ad42-3753371001b5 for instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa on hv-cinder-83482 Jun 24 08:18:54.231852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-10c0f296-eff9-452f-94bf-9e3a0b4cfd76 req-5920b458-bd3f-432e-989d-18e2bd2b8849 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107524 Jun 24 08:18:54.232512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 36/59] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:18:54.515462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:54.516105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:54.522378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.522858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.523633 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.529186 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.533626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:54.534319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:54.540511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.540957 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.541707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.542131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.777043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:54.788154 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1b810fb8-69a1-422a-a4c9-2f0cf16468b7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.258703 Jun 24 08:18:54.788872 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:54.790529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 37/60] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:54 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:54.804389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cdcb204f-67eb-4bf5-8cff-c5e61fb49af1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.294166 Jun 24 08:18:54.805368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 24/61] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:54 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:54.926100 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:54.927534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:54.939976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.943133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.944113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.944800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.952056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:54.953314 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:54.967964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.970076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:54.972756 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:54.975065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:55.472509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:55.483425 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:55.485640 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=85 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:55.487363 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:55.494246 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0fd4336e-0318-47c5-90c2-c8a7b2d636c4 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.548056 Jun 24 08:18:55.497668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 25/62] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:54 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:55.499309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:55.504464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:55.505365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:55.512855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-322f44aa-c369-4211-a36b-99e89aa2eb25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.587726 Jun 24 08:18:55.514862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 38/63] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:54 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:55.514987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:55.514987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:55.515889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:55.516489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:55.602195 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:55.610807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4f3178fb-5ad5-43e1-8bd1-7467238422cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1279 microversion: 2.1 time: 0.111937 Jun 24 08:18:55.612074 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 26/64] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:55 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:55.811856 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:55.813207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:55.828062 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:55.828702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:55.828918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:55.829431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:55.831398 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:55.831888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:55.842636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:55.848132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:55.849163 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:55.849608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.353621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:56.363825 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-03b4610c-3bf3-4163-a994-ae8ad3584e50 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.561722 Jun 24 08:18:56.368621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 39/65] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:55 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:56.474458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:56.486154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a0dd05a3-443f-4527-9add-d39c057accc2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.664639 Jun 24 08:18:56.499281 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 27/66] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:55 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:56.515196 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:56.515808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:56.525703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:56.532602 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:56.533196 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:56.533539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.534598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:56.535106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.545121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:56.551293 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.555797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:56.555797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.731050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=8 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:56.752987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=34 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:56.899993 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:56.908387 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:56.909903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:56.920950 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7171d689-c10d-4791-b43a-d2292ab0e2f6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.393837 Jun 24 08:18:56.922190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 28/67] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:56 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:56.927082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:56.928685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:56.940770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:56.944624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:56.944624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.944624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:56.944624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:56.949939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bf5b90f0-8015-407f-aee4-5017567d0581 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.439404 Jun 24 08:18:56.953872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 40/68] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:56 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:57.087688 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:57.112830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-628f08ab-71dc-406e-a4bf-6caf23450f91 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1279 microversion: 2.1 time: 0.186335 Jun 24 08:18:57.114701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 29/69] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:56 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:57.385523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:57.386205 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:57.395795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.396406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.397291 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.397780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.507728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:57.508315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:57.518365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.519057 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.519824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.520272 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.688831 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:57.698440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-94d39508-7ffd-469c-bc8e-a1c65465d835 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.316792 Jun 24 08:18:57.700399 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 41/70] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:57 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:57.757214 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:57.766212 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7c3a3816-1421-43e8-bf13-479b8faa25cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.262212 Jun 24 08:18:57.767061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 30/71] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:57 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:57.942938 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:57.944122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:57.947813 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=32 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:57.953845 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.954287 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.955052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.955475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.970278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:57.970914 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:57.977096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.977541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:57.979052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:57.979591 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:58.211333 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:58.221229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:58.224474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:58.229309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:58.230443 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-54fe7942-b916-4d62-bfd3-9e24bfe7ca1e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.293676 Jun 24 08:18:58.231373 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 42/72] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:57 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:18:58.238069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:58.238675 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:58.243822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d0fd1caf-9f78-4c30-a2a3-de9a830fd01f tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.277354 Jun 24 08:18:58.244457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 31/73] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:57 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:58.244919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:58.245364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:58.246131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:58.246660 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:58.314552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:58.322311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6f9ed2dc-cd49-419e-8c85-7f7f3f383435 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1279 microversion: 2.1 time: 0.087820 Jun 24 08:18:58.326820 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 43/74] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:58 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:58.728891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:58.729980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:58.748336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:58.754369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:58.754369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:58.754369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:58.784825 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:58.786147 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:58.808313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:58.811373 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:58.812947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:58.841385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.177373 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.183389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.200723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9cddba03-9eed-4575-9872-a79e983558d9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.420578 Jun 24 08:18:59.201437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 44/75] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:58 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:18:59.211044 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-dea14255-3d5d-4b5c-ba31-f80b1fa5c306 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.488979 Jun 24 08:18:59.211044 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 32/76] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:58 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:59.250785 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:59.251774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:59.261017 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.263412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.263412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.263412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.274850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:59.282023 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:59.296428 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.303490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.303490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.303490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.507303 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.522867 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.525661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.531830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8fa8dcf4-30ea-42bc-a154-efeec71b8296 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.280118 Jun 24 08:18:59.533096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 33/77] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:18:59 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:18:59.541651 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:18:59.545630 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:18:59.554268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.554724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.555762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.565183 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.587850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.599640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c4ca397a-7078-4487-ad19-bbc6721ea4d0 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.342239 Jun 24 08:18:59.602019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 45/78] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:59 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:59.666667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:18:59.681980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1e89995c-55bd-4c33-b565-b95d80c5492b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1279 microversion: 2.1 time: 0.146214 Jun 24 08:18:59.682953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 34/79] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:18:59 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:18:59.837370 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-f56af673-dfeb-45b2-aa9e-e2de1e48d4cd req-79228b0d-0a4e-44e0-91ec-dc554beb2c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c224ed6-de35-4bae-a7c8-730721a700c0", "tag": "072982f9-ed8e-452f-86d8-8f755a82116b"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:18:59.846540 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-f56af673-dfeb-45b2-aa9e-e2de1e48d4cd req-79228b0d-0a4e-44e0-91ec-dc554beb2c8f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:18:59.846982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-f56af673-dfeb-45b2-aa9e-e2de1e48d4cd req-79228b0d-0a4e-44e0-91ec-dc554beb2c8f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:18:59.860368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-f56af673-dfeb-45b2-aa9e-e2de1e48d4cd req-79228b0d-0a4e-44e0-91ec-dc554beb2c8f service nova] Creating event network-changed:072982f9-ed8e-452f-86d8-8f755a82116b for instance 1c224ed6-de35-4bae-a7c8-730721a700c0 on hv-cinder-83482 Jun 24 08:18:59.866055 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-f56af673-dfeb-45b2-aa9e-e2de1e48d4cd req-79228b0d-0a4e-44e0-91ec-dc554beb2c8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032074 Jun 24 08:18:59.868360 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 46/80] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:19:00.219121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:00.219719 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:00.219915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:00.220635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:00.227223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.227958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.229134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.229856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.233585 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.243082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.243082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.243082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.399279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:00.568472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:00.573472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:00.576580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-066b0e1a-e38f-46d0-9d69-257f8e02fcd5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.361325 Jun 24 08:19:00.586193 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 47/81] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:00 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:00.599068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4d55ba66-68e4-4fec-9b46-9ed0fa2f0bfd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.374887 Jun 24 08:19:00.599171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:00.599171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:00.599356 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 35/82] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:00 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:00.599612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.600237 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.601169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.601744 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.634473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:00.635195 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:00.648488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.649094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.649934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.650373 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.870681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:00.879873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:00.884721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:00.885676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-de92c0ec-dfdc-449b-8c37-8551d9153af7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.261872 Jun 24 08:19:00.886219 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:00.886584 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 36/83] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:00 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:00.887532 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-301d3ce8-640f-4d77-8681-3d02f477f419 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.300007 Jun 24 08:19:00.888431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 48/84] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:00 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:19:00.904028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:00.908407 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:00.912882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.913450 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:00.914604 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:00.915300 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.085938 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:01.096625 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b0074dc5-5cb1-458f-bf99-e6eaa0632cf3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.208104 Jun 24 08:19:01.106813 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 37/85] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:00 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:01.595632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:01.597169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:01.606157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.606157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.614357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:01.615091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:01.620769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.622865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.628335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.630807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.634636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.635244 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.858202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:01.867832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-daff6e3c-a4b2-4978-baf2-11be2af56530 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.278087 Jun 24 08:19:01.884728 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 49/86] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:01 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:01.900855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-071b67f5-580c-4088-8a45-c224de32769a req-044965c6-55e7-4986-9b5e-966b0b78d22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}, {"name": "network-changed", "server_uuid": "47798514-cc6d-44cd-bb83-cc051cd57531", "tag": "e384c8cd-dcc0-44bf-befe-34c87737476f"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:01.911953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-071b67f5-580c-4088-8a45-c224de32769a req-044965c6-55e7-4986-9b5e-966b0b78d22e service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.912792 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-071b67f5-580c-4088-8a45-c224de32769a req-044965c6-55e7-4986-9b5e-966b0b78d22e service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.932280 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-071b67f5-580c-4088-8a45-c224de32769a req-044965c6-55e7-4986-9b5e-966b0b78d22e service nova] Creating event network-changed:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:19:01.933072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-071b67f5-580c-4088-8a45-c224de32769a req-044965c6-55e7-4986-9b5e-966b0b78d22e service nova] Creating event network-changed:e384c8cd-dcc0-44bf-befe-34c87737476f for instance 47798514-cc6d-44cd-bb83-cc051cd57531 on hv-cinder-83482 Jun 24 08:19:01.941108 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-071b67f5-580c-4088-8a45-c224de32769a req-044965c6-55e7-4986-9b5e-966b0b78d22e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046204 Jun 24 08:19:01.942391 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 50/87] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:01.950769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:01.951355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:01.957965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.958604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.959535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.960229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:01.964394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:01.979563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-af147abe-6144-4aa1-9ece-edf0a7d020c5 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.366311 Jun 24 08:19:01.979563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 38/88] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:01 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:01.991578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:01.992178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:01.998976 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:01.999579 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:02.000717 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:02.001422 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:02.186724 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:02.194461 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d21f2f84-827e-4d52-8683-121a8c33bf8c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.250239 Jun 24 08:19:02.198948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 51/89] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:01 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:02.208370 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:02.208370 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:02.218022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:02.218641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:02.219608 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:02.220189 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:02.232891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:02.247935 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:02.252218 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:02.257182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0ca03389-eaab-48fd-9098-2a1cc6063d93 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.276414 Jun 24 08:19:02.260642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 39/90] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:01 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:19:02.418446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:02.422974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:02.427653 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3a146e7b-2d87-49f7-a0d0-12519f0f25ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.226910 Jun 24 08:19:02.438496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 52/91] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:02 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:02.892609 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:02.893097 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:02.902386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:02.903056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:02.907208 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:02.907801 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:02.995161 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:02.995783 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:03.004050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.004810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.005932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.006523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.136359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:03.162592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-96ec2573-4a4e-45ba-bf4f-305e26b60973 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.274460 Jun 24 08:19:03.166996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 40/92] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:02 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:03.213003 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:03.213811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:03.222920 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.225489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.229238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.229238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.237627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:03.245662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f7e42ba6-7e06-4a3c-bc5d-cd297c156c0a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.255039 Jun 24 08:19:03.257689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 53/93] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:02 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:03.306426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:03.310411 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:03.324976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.325520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.328559 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.329506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.859940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:03.880015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-db2ccd9a-6ecd-40eb-86bb-6a7fa0dda51c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.670985 Jun 24 08:19:03.891584 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 41/94] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:03 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:03.897427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:03.898087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:03.905735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.906179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.906945 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:03.907376 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:03.907859 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:03.923445 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:03.925276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:03.926660 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-45fe15c2-a38e-4d1c-88bc-5eceef1408a0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.651350 Jun 24 08:19:03.929381 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:03.938808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 54/95] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:03 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:19:04.073249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:04.082035 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bc9afba8-379c-4673-a735-c269c5d39431 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.189069 Jun 24 08:19:04.092422 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 42/96] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:03 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:04.092422 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-3d1e9c31-f747-476a-8671-070f72371836 req-07cc5b5c-0366-4c99-b49b-35980bfc2657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316723f1-2496-490c-a542-09dea2bc82c1", "tag": "b0864fbb-b6bf-48ec-8cb1-9e0a270336cf"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:04.102631 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-3d1e9c31-f747-476a-8671-070f72371836 req-07cc5b5c-0366-4c99-b49b-35980bfc2657 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.103074 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-3d1e9c31-f747-476a-8671-070f72371836 req-07cc5b5c-0366-4c99-b49b-35980bfc2657 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.123241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-3d1e9c31-f747-476a-8671-070f72371836 req-07cc5b5c-0366-4c99-b49b-35980bfc2657 service nova] Creating event network-changed:b0864fbb-b6bf-48ec-8cb1-9e0a270336cf for instance 316723f1-2496-490c-a542-09dea2bc82c1 on hv-cinder-83482 Jun 24 08:19:04.123834 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-3d1e9c31-f747-476a-8671-070f72371836 req-07cc5b5c-0366-4c99-b49b-35980bfc2657 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118295) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:19:04.133793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.133793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.134258 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-4727511b-cb6c-483f-b47f-c83d2a2bd889 req-717762d2-1763-4e13-9375-e381729503bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ce4c46-0c8a-4917-8efb-30706cac089c", "name": "network-vif-plugged", "status": "completed", "tag": "823e7cca-f746-4e4d-acb7-1d8522ad4750"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:04.134961 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.134961 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.135429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-4727511b-cb6c-483f-b47f-c83d2a2bd889 req-717762d2-1763-4e13-9375-e381729503bd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.135429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-4727511b-cb6c-483f-b47f-c83d2a2bd889 req-717762d2-1763-4e13-9375-e381729503bd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.138478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.compute.rpcapi [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:19:04.140483 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] Releasing lock "compute-rpcapi-router" {{(pid=118295) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:19:04.153648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-4727511b-cb6c-483f-b47f-c83d2a2bd889 req-717762d2-1763-4e13-9375-e381729503bd service nova] Creating event network-vif-plugged:823e7cca-f746-4e4d-acb7-1d8522ad4750 for instance 02ce4c46-0c8a-4917-8efb-30706cac089c on hv-cinder-83482 Jun 24 08:19:04.156881 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7a28676f-b300-4295-afa1-1be2e5145d0e None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072743 Jun 24 08:19:04.158075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 43/97] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:04.160123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-4727511b-cb6c-483f-b47f-c83d2a2bd889 req-717762d2-1763-4e13-9375-e381729503bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219553 Jun 24 08:19:04.160887 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 55/98] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:04.185178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:04.185975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:04.192697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.196683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.196683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.196683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.265177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:04.266294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:04.273012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.273542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.274381 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.274890 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.369762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:04.381349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c362d2bb-96df-45d8-9087-68f26dcf2601 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.200537 Jun 24 08:19:04.382517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 44/99] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:04 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:04.438639 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:04.447944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-77782d47-f35d-4965-b1d1-14dab8e7a835 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.188638 Jun 24 08:19:04.448607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 56/100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:04 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:04.898218 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:04.899239 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:04.905171 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.905632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.909837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.910288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.945415 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:04.946291 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:04.954138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.955149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:04.956281 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:04.956881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.160488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.169810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-65241463-f1ea-4090-b199-22d7a867ed65 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.275152 Jun 24 08:19:05.173450 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 45/101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:04 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:05.179869 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:05.181049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:05.187991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:05.190324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.191131 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:05.192364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.220511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.240973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.242704 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.246189 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b89e05d0-23a2-4a56-b255-656ee8f2319b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.305658 Jun 24 08:19:05.250320 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 57/102] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:04 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:19:05.347711 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.355554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fe6688f5-2c87-46d8-8409-9271c7eb9900 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.181039 Jun 24 08:19:05.356883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 46/103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:05 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:05.399452 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:05.400104 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:05.410683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:05.410683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.410683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:05.410683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.467640 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:05.469111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:05.491961 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:05.492808 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.496419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:05.497034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:05.804056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.804056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-85c86312-8687-4ac0-9cc6-ba02f158d9cd tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.305158 Jun 24 08:19:05.804056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 58/104] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:05 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:05.805124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:05.805124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c43d24dc-0d7e-4a58-8510-4f4a712c6b48 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.280298 Jun 24 08:19:05.805124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 47/105] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:05 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:06.181165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-06bf4659-942e-46c9-b1d8-b6a38cf9bb3c req-e85bee8a-07b2-476e-954a-7ca1c87cf806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4879e55-2bc5-4df2-b495-a4ba5f0c98fa", "name": "network-vif-plugged", "status": "completed", "tag": "5f99fb72-376e-4446-ad42-3753371001b5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:06.186942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-06bf4659-942e-46c9-b1d8-b6a38cf9bb3c req-e85bee8a-07b2-476e-954a-7ca1c87cf806 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.187779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-06bf4659-942e-46c9-b1d8-b6a38cf9bb3c req-e85bee8a-07b2-476e-954a-7ca1c87cf806 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.188949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:06.189720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:06.199504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.212359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.212359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.212359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.212872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-06bf4659-942e-46c9-b1d8-b6a38cf9bb3c req-e85bee8a-07b2-476e-954a-7ca1c87cf806 service nova] Creating event network-vif-plugged:5f99fb72-376e-4446-ad42-3753371001b5 for instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa on hv-cinder-83482 Jun 24 08:19:06.212872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-06bf4659-942e-46c9-b1d8-b6a38cf9bb3c req-e85bee8a-07b2-476e-954a-7ca1c87cf806 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036831 Jun 24 08:19:06.212872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 59/106] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:06.268855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:06.269616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:06.275819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.276293 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.277244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.277863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.384689 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:06.392473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d18b762a-a2b4-40b1-8401-710e528136d6 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.209535 Jun 24 08:19:06.397378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 48/107] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:06 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:06.403178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:06.404233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:06.411274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.411710 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.412510 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.413036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.432093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:06.440634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:06.442197 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:06.443878 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b3d188d6-e567-404b-b631-24eb3359d586 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.180425 Jun 24 08:19:06.445044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 60/108] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:06 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:06.554289 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:06.562504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-543761b0-48e3-4da8-9913-4450ddb4cb8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.168315 Jun 24 08:19:06.563081 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 49/109] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:06 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:06.718588 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:06.720128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:06.728417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.729381 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.731706 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.731706 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.760414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:06.761274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:06.771506 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.780036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:06.781172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:06.781778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.004519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.015829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b86f247a-2374-4838-ab3b-2dc869ea270a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.259372 Jun 24 08:19:07.017427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 50/110] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:06 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:07.058922 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.068316 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f440a739-7b86-4e63-aecf-dc512b692cb0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.354209 Jun 24 08:19:07.075855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 61/111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:06 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:07.411831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:07.412613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:07.426162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:07.426830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.429560 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:07.431319 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.467231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:07.471083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:07.482071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:07.486898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.487966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:07.489939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.671177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.680814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-dcb6c7e0-4be2-48c0-912e-26e95a41c887 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.273987 Jun 24 08:19:07.683352 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 51/112] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:07 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:07.695007 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:07.695829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:07.709390 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:07.710579 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.711509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:07.712092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:07.737492 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.745945 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.748410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.749801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3db4afe6-6b6f-4e12-b889-d3819e291907 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.291655 Jun 24 08:19:07.750465 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 62/113] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:07 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:07.909532 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:07.917722 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1c379ca6-7372-4965-becc-284c1262f974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.231376 Jun 24 08:19:07.919111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 52/114] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:07 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:08.033732 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:08.034336 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:08.043110 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.043110 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.043110 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.043110 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.090650 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:08.091254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:08.097217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.097667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.098424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.098863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.294264 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:08.307215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d966a6af-9d8d-4b28-8f07-70c193782a1f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.277207 Jun 24 08:19:08.308692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 63/115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:08 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:08.322758 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-4576e9d5-8c61-4209-9089-9118de9880d7 req-baacae5d-67e2-4bc7-8edb-6b72c8efbde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47798514-cc6d-44cd-bb83-cc051cd57531", "name": "network-vif-plugged", "status": "completed", "tag": "e384c8cd-dcc0-44bf-befe-34c87737476f"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:08.333113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-4576e9d5-8c61-4209-9089-9118de9880d7 req-baacae5d-67e2-4bc7-8edb-6b72c8efbde8 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.333725 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-4576e9d5-8c61-4209-9089-9118de9880d7 req-baacae5d-67e2-4bc7-8edb-6b72c8efbde8 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.335849 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:08.345723 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-94a8f2e6-7ca5-4469-b9f6-98b8c6c7ace3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.258986 Jun 24 08:19:08.346907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 53/116] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:08 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:08.359266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-4576e9d5-8c61-4209-9089-9118de9880d7 req-baacae5d-67e2-4bc7-8edb-6b72c8efbde8 service nova] Creating event network-vif-plugged:e384c8cd-dcc0-44bf-befe-34c87737476f for instance 47798514-cc6d-44cd-bb83-cc051cd57531 on hv-cinder-83482 Jun 24 08:19:08.365043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-4576e9d5-8c61-4209-9089-9118de9880d7 req-baacae5d-67e2-4bc7-8edb-6b72c8efbde8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045831 Jun 24 08:19:08.365655 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 64/117] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:08.700639 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:08.702534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:08.713658 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.714391 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.715594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.716187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.770527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:08.770995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:08.779918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.779918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.780824 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:08.781262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:08.971424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:08.979493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-85add10a-0166-4ec6-91ee-94f598403826 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.282719 Jun 24 08:19:08.980383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 54/118] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:08 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:08.994169 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:09.000776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:09.001697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:09.002139 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:09.002919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:09.003343 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:09.013340 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:09.021382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:09.022959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:09.024054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-90dc4d9a-07de-489c-872f-66e9b4e3c780 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.259373 Jun 24 08:19:09.024642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 65/119] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:08 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:09.146192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:09.154328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2c54a876-497e-410e-807a-83af54ad8aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.172102 Jun 24 08:19:09.155101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 55/120] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:08 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:09.324073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:09.325978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:09.332577 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:09.333088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:09.334012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:09.334506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:09.362497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:09.363845 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:09.370354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:09.371253 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:09.378712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:09.379358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:09.609899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:09.619358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8882a015-5370-4e61-b1b7-aaba6bdb1746 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.298939 Jun 24 08:19:09.629967 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 66/121] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:09 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:09.635820 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:09.647891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2dfd0d61-9404-4248-bd3f-a0295be20b88 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1367 microversion: 2.1 time: 0.289084 Jun 24 08:19:09.648671 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 56/122] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:09 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:09.998532 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:09.999310 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:10.010791 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.011500 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.012848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.013292 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.047598 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:10.047598 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:10.053302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.053746 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.054511 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.054937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.382242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.394484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7ead105d-3d75-4837-a9d0-81de6977107a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1315 microversion: 2.1 time: 0.400136 Jun 24 08:19:10.407429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 67/123] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:09 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:10.414094 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:10.415106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:10.423930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.424779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.425925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.426669 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.435231 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.454115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.456392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.459798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-de551f8c-b633-4689-942b-b362cd1d651f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.420845 Jun 24 08:19:10.468964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 57/124] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:10 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:10.475818 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-6bfb5359-1c25-4186-a613-d0614e2c7e2c req-052ef45f-361f-4af1-a547-85e65db40ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "name": "network-vif-plugged", "status": "completed", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:10.487716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-6bfb5359-1c25-4186-a613-d0614e2c7e2c req-052ef45f-361f-4af1-a547-85e65db40ac3 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.488439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-6bfb5359-1c25-4186-a613-d0614e2c7e2c req-052ef45f-361f-4af1-a547-85e65db40ac3 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.503888 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-6bfb5359-1c25-4186-a613-d0614e2c7e2c req-052ef45f-361f-4af1-a547-85e65db40ac3 service nova] Creating event network-vif-plugged:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:19:10.509252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-6bfb5359-1c25-4186-a613-d0614e2c7e2c req-052ef45f-361f-4af1-a547-85e65db40ac3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038931 Jun 24 08:19:10.509837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 58/125] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:10.627982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.637017 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-10fe4251-4bf1-4baa-8327-570ddd455761 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.228166 Jun 24 08:19:10.638748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 68/126] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:10 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:10.638884 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:10.639498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:10.651702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.652650 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.655161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.655161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.670169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:10.670775 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:10.676956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.677638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.678565 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.679141 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.907262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.909621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:10.915566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-666549cc-6722-4c75-8a1f-9a69e36ba2d3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.281693 Jun 24 08:19:10.918940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 59/127] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:10 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:10.919071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a11b3543-436e-473c-b297-c0de6f282102 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1557 microversion: 2.1 time: 0.251343 Jun 24 08:19:10.919071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 69/128] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:10 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1557 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:10.934458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:10.934951 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:10.943118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.943643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.944501 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:10.944997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:10.973185 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:11.097573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c1bcfa17-778a-45da-9fa4-f351301a01eb tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162874 Jun 24 08:19:11.097573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 60/129] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:19:10 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:11.419317 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:11.419317 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:11.427926 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:11.429123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:11.448728 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:11.449242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:11.488114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:11.488827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:11.495066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:11.495677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:11.496576 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:11.497032 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:12.200954 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:12.213674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6d543ebc-7dd9-4c91-9d33-67d65fe2ecd8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1502 microversion: 2.1 time: 0.802820 Jun 24 08:19:12.227629 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 70/130] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:11 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1502 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:12.235449 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:12.236457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:12.244518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:12.245132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:12.246106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:12.246900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:12.247865 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:12.256942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:12.267152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:12.267152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a02d6916-e774-47ca-952f-7c2ffc4de6c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.776634 Jun 24 08:19:12.267152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 61/131] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:11 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:12.267152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:12.267505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:12.282017 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:12.282671 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:12.283510 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:12.284145 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:12.286284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:12.521744 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:12.530477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-96c53b15-83c3-491c-95fc-76771d607271 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.301337 Jun 24 08:19:12.531156 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 71/132] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:12 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:12.537279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-d041ca8d-50fe-4d47-a3c7-70d73a1f129e req-dba42d05-9548-413e-9ddf-40b20b78d264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c224ed6-de35-4bae-a7c8-730721a700c0", "name": "network-vif-plugged", "status": "completed", "tag": "072982f9-ed8e-452f-86d8-8f755a82116b"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:12.548551 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-d041ca8d-50fe-4d47-a3c7-70d73a1f129e req-dba42d05-9548-413e-9ddf-40b20b78d264 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:12.550188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-d041ca8d-50fe-4d47-a3c7-70d73a1f129e req-dba42d05-9548-413e-9ddf-40b20b78d264 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:12.562407 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-d041ca8d-50fe-4d47-a3c7-70d73a1f129e req-dba42d05-9548-413e-9ddf-40b20b78d264 service nova] Creating event network-vif-plugged:072982f9-ed8e-452f-86d8-8f755a82116b for instance 1c224ed6-de35-4bae-a7c8-730721a700c0 on hv-cinder-83482 Jun 24 08:19:12.568180 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-d041ca8d-50fe-4d47-a3c7-70d73a1f129e req-dba42d05-9548-413e-9ddf-40b20b78d264 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035458 Jun 24 08:19:12.569218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 72/133] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:12.573187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:12.581899 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c034a3ee-2b9e-4a19-bb40-559cdafb5d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1362 microversion: 2.1 time: 0.319957 Jun 24 08:19:12.582472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 62/134] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:12 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:13.061875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-17fd0fe8-6dfb-4434-bc5e-e107e60f055c req-55f401ec-fe89-4f94-a398-9808d05bc2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4879e55-2bc5-4df2-b495-a4ba5f0c98fa", "tag": "5f99fb72-376e-4446-ad42-3753371001b5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:13.078882 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-17fd0fe8-6dfb-4434-bc5e-e107e60f055c req-55f401ec-fe89-4f94-a398-9808d05bc2e5 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.100746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-17fd0fe8-6dfb-4434-bc5e-e107e60f055c req-55f401ec-fe89-4f94-a398-9808d05bc2e5 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.116654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-17fd0fe8-6dfb-4434-bc5e-e107e60f055c req-55f401ec-fe89-4f94-a398-9808d05bc2e5 service nova] Creating event network-changed:5f99fb72-376e-4446-ad42-3753371001b5 for instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa on hv-cinder-83482 Jun 24 08:19:13.131987 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-17fd0fe8-6dfb-4434-bc5e-e107e60f055c req-55f401ec-fe89-4f94-a398-9808d05bc2e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076167 Jun 24 08:19:13.136564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 73/135] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:13.303685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:13.306914 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:13.320146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.320623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.323079 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.326491 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.550231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:13.551934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:13.560981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.567795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.567795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.567795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.580305 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:13.597509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:13.602003 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:13.605946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-543dd47f-0a6d-4bc6-a081-faa06137df32 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.322659 Jun 24 08:19:13.607601 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 63/136] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:13 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:19:13.623522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:13.624731 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:13.640476 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.643102 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.644102 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.646448 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.800440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:13.817144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-64877cf2-cbd3-4627-b6a0-60eb9669c1f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.272587 Jun 24 08:19:13.818989 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 74/137] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:13 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:13.850553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:13.860898 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7bce3516-df17-4437-aa8b-50531b0ecce7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1546 microversion: 2.1 time: 0.251314 Jun 24 08:19:13.873176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 64/138] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:13 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1546 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:13.879336 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:13.880048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:13.888576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.890545 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:13.891277 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:13.891886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:14.098782 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e6368705-b9a6-42ea-8efb-dbad5777d755 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223228 Jun 24 08:19:14.107801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 75/139] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:19:13 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:14.596360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-7f1ee7b5-d5e3-4236-a146-fdf21537c5da req-db0019fb-9d04-41ad-a49d-2c8b70bba6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316723f1-2496-490c-a542-09dea2bc82c1", "name": "network-vif-plugged", "status": "completed", "tag": "b0864fbb-b6bf-48ec-8cb1-9e0a270336cf"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:14.602386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:14.615493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-7f1ee7b5-d5e3-4236-a146-fdf21537c5da req-db0019fb-9d04-41ad-a49d-2c8b70bba6aa service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:14.615493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-7f1ee7b5-d5e3-4236-a146-fdf21537c5da req-db0019fb-9d04-41ad-a49d-2c8b70bba6aa service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:14.625844 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:14.626512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:14.629644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:14.631629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-7f1ee7b5-d5e3-4236-a146-fdf21537c5da req-db0019fb-9d04-41ad-a49d-2c8b70bba6aa service nova] Creating event network-vif-plugged:b0864fbb-b6bf-48ec-8cb1-9e0a270336cf for instance 316723f1-2496-490c-a542-09dea2bc82c1 on hv-cinder-83482 Jun 24 08:19:14.638683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-7f1ee7b5-d5e3-4236-a146-fdf21537c5da req-db0019fb-9d04-41ad-a49d-2c8b70bba6aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052873 Jun 24 08:19:14.639855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 65/140] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:14.640019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:14.643969 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:14.644794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:14.647403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:14.817272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:14.827568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:14.831234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:14.832574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e9c3a468-2afd-4f3f-bffb-89c086b4a461 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1408 microversion: 2.20 time: 0.211540 Jun 24 08:19:14.833594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 76/141] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:14 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:14.845943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:14.847087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:14.853493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:14.857892 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:14.858553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:14.859490 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:14.860078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:15.046997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:15.055457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3b2380dc-da9f-4771-9325-dcb7e8b7cc17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.224265 Jun 24 08:19:15.057997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 66/142] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:14 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:15.101258 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5562ba9b-c186-4d98-9148-857c8dca83a0"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:15.102421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:15.109987 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:15.110652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:15.112064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:15.115891 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:15.851196 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:15.851927 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:15.859270 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:15.859701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:15.860472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:15.860896 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:16.020149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:16.032685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:16.035070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:16.039204 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-45d6cc82-5f80-496b-b747-c7e15980630c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1599 microversion: 2.20 time: 0.191881 Jun 24 08:19:16.052892 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 67/143] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:19:15 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:19:16.064569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:16.064569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:16.085089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:16.085612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:16.087320 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:16.087821 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:16.266648 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ccd32449-5328-41a6-8b09-fc0adac4879a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.205135 Jun 24 08:19:16.266648 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 68/144] 10.222.0.42 () {60 vars in 1315 bytes} [Fri Jun 24 08:19:16 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:19:16.267524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:16.268318 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:16.282377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:16.283576 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:16.285265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:16.286028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:16.439267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:16.449556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5e12f56f-262d-4828-ad72-7bbf66700aa0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.183192 Jun 24 08:19:16.449556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 69/145] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:16 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:16.453029 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-294f3c02-bc2b-4341-8d10-63ef7b8de39d req-2c6a246b-d0b7-4bc6-816e-f9123ba0f6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47798514-cc6d-44cd-bb83-cc051cd57531", "tag": "e384c8cd-dcc0-44bf-befe-34c87737476f"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:16.462194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-294f3c02-bc2b-4341-8d10-63ef7b8de39d req-2c6a246b-d0b7-4bc6-816e-f9123ba0f6b7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:16.466969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-294f3c02-bc2b-4341-8d10-63ef7b8de39d req-2c6a246b-d0b7-4bc6-816e-f9123ba0f6b7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:16.476235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-294f3c02-bc2b-4341-8d10-63ef7b8de39d req-2c6a246b-d0b7-4bc6-816e-f9123ba0f6b7 service nova] Creating event network-changed:e384c8cd-dcc0-44bf-befe-34c87737476f for instance 47798514-cc6d-44cd-bb83-cc051cd57531 on hv-cinder-83482 Jun 24 08:19:16.482459 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-294f3c02-bc2b-4341-8d10-63ef7b8de39d req-2c6a246b-d0b7-4bc6-816e-f9123ba0f6b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033283 Jun 24 08:19:16.483556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 70/146] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:17.021914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-78ba82ae-7fb6-4e97-8c35-77fb3904085b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "POST /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.924600 Jun 24 08:19:17.027461 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 77/147] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:19:15 2022] POST /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c/os-volume_attachments => generated 194 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:17.472528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:17.473561 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:17.483130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:17.483676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:17.484726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:17.485298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:17.660374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:17.669398 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e7b28db4-53ae-4af7-973a-c884cf7857d2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.207575 Jun 24 08:19:17.669975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 71/148] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:17 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:18.511735 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-262decd4-de9f-4b37-affa-8b1efb43274f req-316feb1a-9790-4ffa-9dad-b29c54c1ecaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:18.518237 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-262decd4-de9f-4b37-affa-8b1efb43274f req-316feb1a-9790-4ffa-9dad-b29c54c1ecaf service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:18.518683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-262decd4-de9f-4b37-affa-8b1efb43274f req-316feb1a-9790-4ffa-9dad-b29c54c1ecaf service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:18.530853 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-262decd4-de9f-4b37-affa-8b1efb43274f req-316feb1a-9790-4ffa-9dad-b29c54c1ecaf service nova] Creating event network-changed:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:19:18.536743 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-262decd4-de9f-4b37-affa-8b1efb43274f req-316feb1a-9790-4ffa-9dad-b29c54c1ecaf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033320 Jun 24 08:19:18.537709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 78/149] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:18.686526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:18.687296 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:18.693504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:18.695570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:18.697899 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:18.698506 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:18.884416 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:18.884847 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-baf62c0e-8c58-4999-a095-7fb5d549ed7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1321 microversion: 2.1 time: 0.202121 Jun 24 08:19:18.885413 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 72/150] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:18 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:19.905857 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:19.906552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:19.913470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:19.914367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:19.915137 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:19.915568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:20.098520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:20.106037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a399bafc-a6e2-4312-8f95-c28a82075160 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1514 microversion: 2.1 time: 0.207669 Jun 24 08:19:20.106597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 79/151] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:19 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:20.125121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:20.126033 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:20.133458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:20.133892 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:20.134640 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:20.135067 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:20.158537 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'flavor' on Instance uuid 316723f1-2496-490c-a542-09dea2bc82c1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:19:20.594414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-65b772b4-31cc-44a9-b417-10605c9f819e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1/action" status: 200 len: 32 microversion: 2.1 time: 0.474596 Jun 24 08:19:20.595638 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 73/152] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:19:20 2022] POST /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:19:20.607662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:20.608352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:20.618321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:20.618766 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:20.619536 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:20.620635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:21.019889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:21.028291 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f04b527c-d651-408b-a7c8-3a5f179bbfd7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.426687 Jun 24 08:19:21.029542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:20 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:22.046778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:22.047611 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:22.054550 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:22.054991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:22.055755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:22.056479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:22.189356 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:22.196921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d53019b3-7588-43ca-819d-ef1693523447 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.154996 Jun 24 08:19:22.197418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 74/154] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:22 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:23.214712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:23.215941 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:23.222550 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:23.222997 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:23.223752 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:23.224182 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:23.360530 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:23.368018 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-375181de-b01c-4076-b428-6efbd2e7b891 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.157161 Jun 24 08:19:23.368612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 81/155] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:23 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:24.385377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:24.386153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:24.393028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:24.393478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:24.394241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:24.394709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:24.524953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:24.533052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-257a2996-a0d7-4b53-859d-c22866e7e325 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.151841 Jun 24 08:19:24.533624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 75/156] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:24 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:25.551215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:25.551817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:25.558553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:25.558998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:25.559745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:25.560174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:25.696503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:25.703920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2d036611-e7fd-4cc6-bb55-39ac2a8dbf84 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.156563 Jun 24 08:19:25.704518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 82/157] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:25 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:26.720608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:26.721212 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:26.727314 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:26.727749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:26.728566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:26.728982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:26.862701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:26.865027 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:26.870792 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8e4ffee6-221d-4657-a187-96be3553facf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.154209 Jun 24 08:19:26.871837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:26 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:27.888157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:27.888829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:27.895602 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:27.896157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:27.896933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:27.897368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:28.052938 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:28.060795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0f98e856-c6ce-4aef-91cc-36a8bfeb6de4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.176416 Jun 24 08:19:28.062429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 83/159] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:27 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:29.079130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:29.080190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:29.087227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:29.088218 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:29.088553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:29.089134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:29.198610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:29.199243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:29.206387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:29.206915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:29.207684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:29.208121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:29.233316 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:29.238202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:19:29.241157 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-efc1d74b-d3de-40e1-b00a-531da9dd643b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.167143 Jun 24 08:19:29.241734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 77/160] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:29 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:29.575174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-69b08dd9-6dbb-465f-a525-5540ba9d791c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 204 len: 0 microversion: 2.1 time: 0.379881 Jun 24 08:19:29.578828 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 84/161] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:19:29 2022] DELETE /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:19:29.584476 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:29.585305 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:29.591444 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:29.591889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:29.592731 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:29.593161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:29.723489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:29.731337 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-95eb46e1-ac59-4546-8eda-82f47227418c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1554 microversion: 2.1 time: 0.151182 Jun 24 08:19:29.735123 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 78/162] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:29 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:30.259335 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:30.260210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:30.267296 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:30.267677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:30.268462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:30.268895 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:30.412134 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:30.420464 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3cc0287b-418a-4c65-8a0c-72ecd08cc35c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.165096 Jun 24 08:19:30.422138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 85/163] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:30 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:30.752008 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:30.752715 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:30.762215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:30.765082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:30.765082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:30.765082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:30.907670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:30.917220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8b2cc998-4203-4d4e-a9a9-499ebcf0bdd1 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1554 microversion: 2.1 time: 0.170471 Jun 24 08:19:30.917220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:30 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:31.438531 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:31.439137 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:31.445393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:31.445848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:31.446722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:31.447129 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:31.584761 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:31.596919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d84c9584-de2a-47c3-bc7e-7b0e51156424 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.162305 Jun 24 08:19:31.597871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 86/165] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:31 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:31.932895 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:31.933495 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:31.940350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:31.940860 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:31.941617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:31.942041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:32.077788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:32.086286 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d325a807-ae85-4f3f-8a70-71527dca785a tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1554 microversion: 2.1 time: 0.157944 Jun 24 08:19:32.087022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:31 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:32.614283 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:32.614877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:32.621683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:32.622144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:32.622918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:32.623346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:32.643603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:32.794947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:32.802984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dd3ad851-118f-4e7d-a1b7-ab8c96a9be37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.192465 Jun 24 08:19:32.803565 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:32 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:33.045836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-efbb4d6e-0670-45b9-904b-3fa9969329eb req-cf6be620-52e0-4a88-b8fd-a2b071d0dc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ce4c46-0c8a-4917-8efb-30706cac089c", "name": "network-vif-deleted", "tag": "823e7cca-f746-4e4d-acb7-1d8522ad4750"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:33.057362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-efbb4d6e-0670-45b9-904b-3fa9969329eb req-cf6be620-52e0-4a88-b8fd-a2b071d0dc08 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:33.057915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-efbb4d6e-0670-45b9-904b-3fa9969329eb req-cf6be620-52e0-4a88-b8fd-a2b071d0dc08 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:33.079480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-efbb4d6e-0670-45b9-904b-3fa9969329eb req-cf6be620-52e0-4a88-b8fd-a2b071d0dc08 service nova] Creating event network-vif-deleted:823e7cca-f746-4e4d-acb7-1d8522ad4750 for instance 02ce4c46-0c8a-4917-8efb-30706cac089c on hv-cinder-83482 Jun 24 08:19:33.085637 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-efbb4d6e-0670-45b9-904b-3fa9969329eb req-cf6be620-52e0-4a88-b8fd-a2b071d0dc08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044460 Jun 24 08:19:33.086367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 81/168] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:33.104163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:33.108094 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:33.114042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:33.114665 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:33.116363 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:33.116953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:33.200071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:33.209311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-214135c3-7401-4325-ab3e-ed9d6240e6a8 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1512 microversion: 2.1 time: 0.110329 Jun 24 08:19:33.209890 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:33 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1512 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:33.820922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:33.840122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:33.840122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:33.840122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:33.840122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:33.840491 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:33.970454 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:33.981254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3589efe5-de5c-4fca-a801-8ce46f7240f5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.164757 Jun 24 08:19:33.981833 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 82/170] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:33 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:34.227047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:34.227752 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:34.238168 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:34.238616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:34.239436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:34.239868 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:34.272915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:34.273369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:34.273971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lazy-loading 'fault' on Instance uuid 02ce4c46-0c8a-4917-8efb-30706cac089c {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:19:34.327226 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f611b3dde95e44c7931445bb3ef1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7d7e0a5614243974c4c44ec466b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:34.341359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-24e3c3e6-f27e-4f1b-8ffc-7279139bb0e7 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 200 len: 1351 microversion: 2.1 time: 0.118298 Jun 24 08:19:34.347309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 89/171] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:34 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:34.999600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:35.000266 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:35.006418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:35.006863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:35.008499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:35.008499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:35.138968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:35.146503 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-907dd4b0-89c6-422f-9384-1d406a51aec4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.151532 Jun 24 08:19:35.147117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 83/172] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:34 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:35.360628 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:35.361416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:35.389512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:35.390245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:35.391173 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:35.391765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:35.407223 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] HTTP exception thrown: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Request method failure captured: Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c HTTP/1.1 Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNSXAbMqoS7dGcaCPqVjCWGJpgcIE4PI3K-xjFz17V5OrFu3iRpCXtqt6rXCgNGYVPenw7Vhsv2RSgA69ptaRwQUvLRJxuyOksizl5wn9RDGfXclG6DXImlLAAzO_dBFbzMHVL_S-GpBBmnIR7nccQVovIxybAXLeuTgURSTnLsFyM Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:19:35.412513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14f7d7e0a5614243974c4c44ec466b14", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}] Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: f611b3dde95e44c7931445bb3ef1f59a Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.413995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '02ce4c46-0c8a-4917-8efb-30706cac089c'} Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:19:35.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.416164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.417429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Returning 404 to user: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:19:35.417429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f94dcfdd-8b6d-41f8-a2ef-46050607631c tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 404 len: 111 microversion: 2.1 time: 0.058866 Jun 24 08:19:35.417429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 90/173] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:35 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:19:35.538519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:35.538519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:35.541799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:35.542235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:35.542980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:35.543410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:35.557633 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] HTTP exception thrown: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Request method failure captured: Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c/os-volume_attachments HTTP/1.1 Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNSXAbMqoS7dGcaCPqVjCWGJpgcIE4PI3K-xjFz17V5OrFu3iRpCXtqt6rXCgNGYVPenw7Vhsv2RSgA69ptaRwQUvLRJxuyOksizl5wn9RDGfXclG6DXImlLAAzO_dBFbzMHVL_S-GpBBmnIR7nccQVovIxybAXLeuTgURSTnLsFyM Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:19:35.569001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14f7d7e0a5614243974c4c44ec466b14", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}] Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: f611b3dde95e44c7931445bb3ef1f59a Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.570540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'server_id': '02ce4c46-0c8a-4917-8efb-30706cac089c'} Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:19:35.571221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:35.572354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:35.573434 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Returning 404 to user: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:19:35.573434 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bdd892b6-6e27-45e4-8e4c-d04929a45b6b tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040854 Jun 24 08:19:35.573434 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 84/174] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:19:35 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:19:36.164010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:36.164468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:36.171296 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:36.171971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:36.172929 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:36.173510 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:36.306266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:36.335375 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-434cbd53-8072-4d98-8a81-bded13082170 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.155722 Jun 24 08:19:36.335375 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:36 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:36.949644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:36.950200 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:36.957717 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:36.958224 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:36.959071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:36.959566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:36.977877 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] HTTP exception thrown: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Request method failure captured: Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c HTTP/1.1 Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNSXAbMqoS7dGcaCPqVjCWGJpgcIE4PI3K-xjFz17V5OrFu3iRpCXtqt6rXCgNGYVPenw7Vhsv2RSgA69ptaRwQUvLRJxuyOksizl5wn9RDGfXclG6DXImlLAAzO_dBFbzMHVL_S-GpBBmnIR7nccQVovIxybAXLeuTgURSTnLsFyM Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:19:36.978383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14f7d7e0a5614243974c4c44ec466b14", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}] Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: f611b3dde95e44c7931445bb3ef1f59a Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:36.979673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '02ce4c46-0c8a-4917-8efb-30706cac089c'} Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:19:36.980360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:36.981428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:36.982474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Returning 404 to user: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:19:36.982474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f8890a30-f140-4042-84c7-6e98342417b9 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 404 len: 111 microversion: 2.1 time: 0.034182 Jun 24 08:19:36.982474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:19:36 2022] DELETE /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:19:36.990115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:36.990806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] [instance: 02ce4c46-0c8a-4917-8efb-30706cac089c] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:36.997515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:37.000775 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:37.000775 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:37.000775 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:37.015364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] HTTP exception thrown: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Request method failure captured: Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c HTTP/1.1 Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNSXAbMqoS7dGcaCPqVjCWGJpgcIE4PI3K-xjFz17V5OrFu3iRpCXtqt6rXCgNGYVPenw7Vhsv2RSgA69ptaRwQUvLRJxuyOksizl5wn9RDGfXclG6DXImlLAAzO_dBFbzMHVL_S-GpBBmnIR7nccQVovIxybAXLeuTgURSTnLsFyM Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:19:37.016901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14f7d7e0a5614243974c4c44ec466b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14f7d7e0a5614243974c4c44ec466b14", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14f7d7e0a5614243974c4c44ec466b14"}]}] Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 14f7d7e0a5614243974c4c44ec466b14 Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-DeleteServersTestJSON-76107447 Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: f611b3dde95e44c7931445bb3ef1f59a Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-DeleteServersTestJSON-76107447-project Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:37.018410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '02ce4c46-0c8a-4917-8efb-30706cac089c'} Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:19:37.019142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. Jun 24 08:19:37.020218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:19:37.021221 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] Returning 404 to user: Instance 02ce4c46-0c8a-4917-8efb-30706cac089c could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:19:37.021221 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-88da3b7e-b09d-4efa-9bd0-e220d9f7eb98 tempest-DeleteServersTestJSON-76107447 tempest-DeleteServersTestJSON-76107447-project] 10.222.0.42 "GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c" status: 404 len: 111 microversion: 2.1 time: 0.032194 Jun 24 08:19:37.021221 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 92/177] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:36 2022] GET /compute/v2.1/servers/02ce4c46-0c8a-4917-8efb-30706cac089c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:19:37.332821 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:37.333420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:37.339385 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:37.339826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:37.340626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:37.341045 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:37.561739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:37.575591 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c92a30e6-9738-4400-a141-b96270d46ce7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.246531 Jun 24 08:19:37.576500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 86/178] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:37 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:38.594909 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:38.595642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:38.602467 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:38.602913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:38.603680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:38.604111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:38.923802 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:38.932022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2157e7e9-9339-4f4e-8214-e71be70a2c18 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.341960 Jun 24 08:19:38.932744 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 93/179] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:38 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:39.949571 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:39.950267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:39.956636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:39.957076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:39.957840 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:39.958264 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:40.112133 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:40.119506 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9b5af123-1d19-4942-8db2-0afe34448fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.173687 Jun 24 08:19:40.120071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:39 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:41.136135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:41.137058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:41.146565 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:41.147143 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:41.148023 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:41.148685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:41.514396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:41.527208 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5ed3f280-fd67-4338-8c2f-b45190066ee5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.394849 Jun 24 08:19:41.528372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 94/181] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:41 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:42.545193 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:42.545859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:42.551975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:42.552456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:42.553214 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:42.553645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:42.683956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:42.692525 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0ab4a0d3-2b4f-4598-b033-53e203b59147 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.151248 Jun 24 08:19:42.696654 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 88/182] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:42 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:43.714367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:43.714949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:43.721096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:43.721704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:43.722463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:43.722981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:43.728222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-14683f7d-86bd-4870-89c2-29fa6321ce6c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Action: 'create', calling method: .version_select at 0x7f149654b1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-845107450"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:43.855271 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:43.863902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1f480026-cff3-4da4-bd54-9d4418b525cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.153370 Jun 24 08:19:43.864600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 89/183] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:43 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:44.466024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-14683f7d-86bd-4870-89c2-29fa6321ce6c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.857891 Jun 24 08:19:44.466669 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 95/184] 10.222.0.42 () {60 vars in 1154 bytes} [Fri Jun 24 08:19:43 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 859 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 08:19:44.479040 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0ecb213e-270c-42d3-ac25-046bdf253c20 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149640f670>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:44.531028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0ecb213e-270c-42d3-ac25-046bdf253c20 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 200 len: 344 microversion: 2.1 time: 0.056512 Jun 24 08:19:44.537330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 90/185] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:19:44 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:44.881560 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:44.882253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:44.889271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:44.889722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:44.891105 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:44.891587 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:45.033021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:45.040695 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1031d289-bf2e-4e8a-a72a-c28e79232c98 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.163543 Jun 24 08:19:45.041597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 96/186] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:44 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:45.546309 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5e9f9573-84ba-415e-b46d-aa7f599afa1c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c6940>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:45.611078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5e9f9573-84ba-415e-b46d-aa7f599afa1c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 200 len: 345 microversion: 2.1 time: 0.069999 Jun 24 08:19:45.611644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 91/187] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:19:45 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:45.622851 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d36c53a7-e212-458e-944c-880615cef81b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Action: 'create', calling method: .version_select at 0x7f14965035e0>, body: {"snapshot": {"volume_id": "ad920a6a-f123-4f4c-99dd-3000e159a2a5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2143946273"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:19:46.058113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:46.058721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:46.060740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=47 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:46.066326 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:46.066770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:46.067534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:46.067964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:46.113462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d36c53a7-e212-458e-944c-880615cef81b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.492503 Jun 24 08:19:46.113462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 97/188] 10.222.0.42 () {60 vars in 1161 bytes} [Fri Jun 24 08:19:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:46.122231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a46ae27c-a58d-47e4-b648-44ff375120af tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14964e2160>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:46.171050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a46ae27c-a58d-47e4-b648-44ff375120af tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.052804 Jun 24 08:19:46.171733 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 98/189] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:46 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:46.181398 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4e55c165-6855-4adf-8039-8c317336f87b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149654b310>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:46.210924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:46.221581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8d091e95-3969-436a-ad6f-cb270d1d0676 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.167438 Jun 24 08:19:46.226299 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 92/190] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:46 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:19:46.228347 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4e55c165-6855-4adf-8039-8c317336f87b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.049709 Jun 24 08:19:46.229275 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 99/191] 10.222.0.42 () {58 vars in 1139 bytes} [Fri Jun 24 08:19:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:46.252398 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dbcdd650-0775-4228-81e8-518b88a12c63 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149640fa60>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:46.281098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-dbcdd650-0775-4228-81e8-518b88a12c63 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.039653 Jun 24 08:19:46.282246 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 93/192] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:46 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:47.239398 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:47.240000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:47.241928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:47.246683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:47.247126 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:47.247870 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:47.248328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:47.292788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3356d98a-4b6f-47a3-9c9b-346929a09592 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c6a60>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:47.323233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3356d98a-4b6f-47a3-9c9b-346929a09592 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.034287 Jun 24 08:19:47.329283 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 94/193] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:47 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:47.384695 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:47.393898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7ecdf87d-d92b-45be-b55e-3e1d373e6666 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.158923 Jun 24 08:19:47.394608 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 100/194] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:47 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:48.335009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3d01bf36-9bfb-42b5-8a9c-53e49d8e358c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c68b0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:48.365011 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3d01bf36-9bfb-42b5-8a9c-53e49d8e358c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.033740 Jun 24 08:19:48.365570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 95/195] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:48 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:48.410870 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:48.411466 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:48.417966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:48.418406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:48.419151 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:48.419571 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:48.550073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:48.557721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-61ae81b5-07ef-49b6-94cf-bddd0047f61b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.151401 Jun 24 08:19:48.558522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 101/196] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:48 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:49.377665 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cbdf25b5-2968-4428-a514-60084b5a9bd5 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963a0790>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:49.407263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cbdf25b5-2968-4428-a514-60084b5a9bd5 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.034129 Jun 24 08:19:49.407818 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 96/197] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:49 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:49.575107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:49.575713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:49.582920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:49.583368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:49.584133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:49.584604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:49.717169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:49.725369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d7490352-03c4-4e73-b050-787b73e691eb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.154457 Jun 24 08:19:49.725930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 102/198] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:49 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:50.418855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ea34d1ca-151b-49f5-8687-0e769a31036c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c6430>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:50.449196 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ea34d1ca-151b-49f5-8687-0e769a31036c tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.034068 Jun 24 08:19:50.449766 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 97/199] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:50 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:50.742797 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:50.743402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:50.750615 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:50.751072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:50.751817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:50.752272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:50.879244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:50.886824 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b3256a36-b572-4456-945c-de7931667474 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.148020 Jun 24 08:19:50.887382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 103/200] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:50 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:51.462068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9b2ff3fc-7200-46f8-a20f-ed202a51a800 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c65e0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:51.491433 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9b2ff3fc-7200-46f8-a20f-ed202a51a800 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.033109 Jun 24 08:19:51.491986 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 98/201] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:51 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:51.903450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:51.904043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:51.910543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:51.911031 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:51.911804 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:51.912264 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:52.050700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:52.058960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e4f3aef9-0508-4350-ae21-d469acc66445 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.159299 Jun 24 08:19:52.059692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 104/202] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:51 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:52.503784 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b801144e-0b6b-4569-920f-da7afbe8dd2b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149640fb80>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:52.532925 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b801144e-0b6b-4569-920f-da7afbe8dd2b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.033390 Jun 24 08:19:52.533452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 99/203] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:52 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:53.074806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:53.075440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:53.081988 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:53.082439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:53.083187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:53.083617 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:53.209233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:53.216625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-683f8402-f671-4fec-88b5-114fd828577a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.145688 Jun 24 08:19:53.217192 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 105/204] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:53 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:53.544832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bde6f9bd-cc19-4a9b-b93e-cc79d8694fad tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149653eee0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:53.574697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bde6f9bd-cc19-4a9b-b93e-cc79d8694fad tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 288 microversion: 2.1 time: 0.033732 Jun 24 08:19:53.575257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 100/205] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:53 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:53.586000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d62f0703-2ec5-4138-bdb6-5ca9cde31963 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963cb4c0>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:53.730322 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d62f0703-2ec5-4138-bdb6-5ca9cde31963 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 202 len: 0 microversion: 2.1 time: 0.148111 Jun 24 08:19:53.730892 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 106/206] 10.222.0.42 () {58 vars in 1253 bytes} [Fri Jun 24 08:19:53 2022] DELETE /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:19:53.740039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-aae441ee-ef9b-48ad-89d7-7d1a0fc386e3 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149640fc10>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:53.769951 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-aae441ee-ef9b-48ad-89d7-7d1a0fc386e3 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.034230 Jun 24 08:19:53.770511 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 101/207] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:53 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:54.234030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:54.234657 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:54.241364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:54.241810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:54.242551 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:54.242975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:54.372758 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:54.380617 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e7ca70c7-637b-4117-ac2d-8deafc1d135d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.150838 Jun 24 08:19:54.381170 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 107/208] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:54 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:54.781357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-510430b4-c00f-4883-be51-d9ae269250bd tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c6f70>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:54.812135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-510430b4-c00f-4883-be51-d9ae269250bd tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.034459 Jun 24 08:19:54.812725 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 102/209] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:54 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:55.397477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:55.398077 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:55.404712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:55.405162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:55.405909 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:55.406386 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:55.532780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:55.540125 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-513946d5-3d58-4abd-b59c-9fee339ee73a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.146551 Jun 24 08:19:55.540715 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 108/210] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:55 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:55.822725 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b7ffefff-0cb5-4369-ada2-910e0a14a79b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c69d0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:55.851444 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b7ffefff-0cb5-4369-ada2-910e0a14a79b tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 200 len: 287 microversion: 2.1 time: 0.032545 Jun 24 08:19:55.852002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:55 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:56.557283 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:56.558150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:56.564555 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:56.565013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:56.565780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:56.566219 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:56.704886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:56.712347 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bdf979a7-fc4c-430d-9f76-235c0b240c4a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.158891 Jun 24 08:19:56.713001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:56 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:56.859642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=73 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:56.863784 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dba4c368-ac5d-4416-ba4d-aa5745b3cfcb tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963c6af0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:56.924495 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-dba4c368-ac5d-4416-ba4d-aa5745b3cfcb tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] HTTP exception thrown: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dba4c368-ac5d-4416-ba4d-aa5745b3cfcb tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Request method failure captured: Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 HTTP/1.1 Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXOfYzqITDsZQFQRGfW9h3NS_cPIxx5LMw58FKIJhDE767iOtz615nvRWbOihI7qpe8hVie4EBZwPBqx9Q8GVSabKsEc_XrLGrXhMnq9vu3LFqA6vvm6m-hTf-euklle1aX9irmQvCa9RG10zD-upjGK1ThTmd-Sfw46ZGNsbEPa-pg Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:19:56.927992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_894cff7b9106408bb865f52debd2b2dd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}] Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 7c30caf193324cc88eadf14f82a74a57 Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'd1f1d675-15cd-40e0-8ada-3e1f009ba859'} Jun 24 08:19:56.929554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. (HTTP 404) (Request-ID: req-e466ced9-a1e6-4996-a4fd-c8532ccc1a85) Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.930569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:19:56.931735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 08:19:56.933559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dba4c368-ac5d-4416-ba4d-aa5745b3cfcb tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Returning 404 to user: Snapshot d1f1d675-15cd-40e0-8ada-3e1f009ba859 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-dba4c368-ac5d-4416-ba4d-aa5745b3cfcb tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859" status: 404 len: 111 microversion: 2.1 time: 0.071594 Jun 24 08:19:56.935522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 104/213] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:19:56 2022] GET /compute/v2.1/os-snapshots/d1f1d675-15cd-40e0-8ada-3e1f009ba859 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:19:56.940685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-25424fc6-2926-4747-91c2-bb4ad777a5b3 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14964e2d30>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:57.142749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-25424fc6-2926-4747-91c2-bb4ad777a5b3 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 202 len: 0 microversion: 2.1 time: 0.205167 Jun 24 08:19:57.142749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 110/214] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:19:56 2022] DELETE /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:19:57.150990 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-017ffd36-d7bb-47b9-8b25-344502ac3eae tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963a08b0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:57.197882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-017ffd36-d7bb-47b9-8b25-344502ac3eae tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 200 len: 344 microversion: 2.1 time: 0.050663 Jun 24 08:19:57.198450 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 105/215] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:19:57 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:19:57.730651 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:57.731252 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:57.737095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:57.737543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:57.738300 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:57.738735 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:57.743307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:57.873747 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:57.881921 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-066f8007-b508-43d1-8199-c4b69ea46f03 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.156118 Jun 24 08:19:57.882483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 111/216] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:57 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:58.207223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:58.211156 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-aa86ec94-2082-49d3-b018-943b32f8e547 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963a0160>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:58.259387 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-aa86ec94-2082-49d3-b018-943b32f8e547 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 200 len: 344 microversion: 2.1 time: 0.052786 Jun 24 08:19:58.259979 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 106/217] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:19:58 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:19:58.898313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:58.898940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:19:58.905288 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:58.905729 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:58.906470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:19:58.906898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:19:59.036602 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:19:59.043882 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7a3c720a-40c4-4296-8c77-a4afb56a2d16 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.149316 Jun 24 08:19:59.044544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 112/218] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:19:58 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:19:59.270823 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3ba25731-c5a8-43b4-ba92-ce3081a82dcf tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f149640fa60>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:19:59.317307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3ba25731-c5a8-43b4-ba92-ce3081a82dcf tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 200 len: 344 microversion: 2.1 time: 0.050253 Jun 24 08:19:59.317891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 107/219] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:19:59 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:00.062108 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:00.091068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:00.091068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:00.091068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:00.091068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:00.091426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:00.203360 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:00.211539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6263e8b4-925a-49b4-a4d7-51ebb6149b32 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.153537 Jun 24 08:20:00.212107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 113/220] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:00 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:00.329593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e0950ae9-437c-4242-a687-f9680487b40d tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963a05e0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:00.376459 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e0950ae9-437c-4242-a687-f9680487b40d tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 200 len: 344 microversion: 2.1 time: 0.050479 Jun 24 08:20:00.377042 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:20:00 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:20:01.228748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:01.229424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:01.235983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:01.236450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:01.237233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:01.237670 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:01.384388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:01.389111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-97071836-7127-439c-b782-cfcbb866cb38 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963a0f70>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:01.393368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2327031f-0ae1-4142-b5d1-74c5126e8b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.168425 Jun 24 08:20:01.394171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:01 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:01.420924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-97071836-7127-439c-b782-cfcbb866cb38 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] HTTP exception thrown: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-97071836-7127-439c-b782-cfcbb866cb38 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Request method failure captured: Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 HTTP/1.1 Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXOfYzqITDsZQFQRGfW9h3NS_cPIxx5LMw58FKIJhDE767iOtz615nvRWbOihI7qpe8hVie4EBZwPBqx9Q8GVSabKsEc_XrLGrXhMnq9vu3LFqA6vvm6m-hTf-euklle1aX9irmQvCa9RG10zD-upjGK1ThTmd-Sfw46ZGNsbEPa-pg Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:20:01.424015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_894cff7b9106408bb865f52debd2b2dd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}] Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 7c30caf193324cc88eadf14f82a74a57 Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'ad920a6a-f123-4f4c-99dd-3000e159a2a5'} Jun 24 08:20:01.429076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. (HTTP 404) (Request-ID: req-eac4e41d-6483-4ffc-bfb2-3585ea1a0d9e) Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.430265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:20:01.431388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:20:01.432452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-97071836-7127-439c-b782-cfcbb866cb38 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Returning 404 to user: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-97071836-7127-439c-b782-cfcbb866cb38 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 404 len: 109 microversion: 2.1 time: 0.040506 Jun 24 08:20:01.433774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 109/223] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:20:01 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:20:01.442246 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-70965745-075d-499b-aaca-4b94f026e425 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f1496503c10>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:01.475811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-70965745-075d-499b-aaca-4b94f026e425 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] HTTP exception thrown: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-70965745-075d-499b-aaca-4b94f026e425 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Request method failure captured: Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: DELETE /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 HTTP/1.1 Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXOfYzqITDsZQFQRGfW9h3NS_cPIxx5LMw58FKIJhDE767iOtz615nvRWbOihI7qpe8hVie4EBZwPBqx9Q8GVSabKsEc_XrLGrXhMnq9vu3LFqA6vvm6m-hTf-euklle1aX9irmQvCa9RG10zD-upjGK1ThTmd-Sfw46ZGNsbEPa-pg Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:20:01.479403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_894cff7b9106408bb865f52debd2b2dd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}] Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 7c30caf193324cc88eadf14f82a74a57 Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'ad920a6a-f123-4f4c-99dd-3000e159a2a5'} Jun 24 08:20:01.480666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. (HTTP 404) (Request-ID: req-0e4fb4c2-2f2d-4a66-925a-0a7b6e7b40f6) Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.481903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:20:01.483050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:20:01.484529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-70965745-075d-499b-aaca-4b94f026e425 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Returning 404 to user: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-70965745-075d-499b-aaca-4b94f026e425 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 404 len: 109 microversion: 2.1 time: 0.043075 Jun 24 08:20:01.486701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 115/224] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:20:01 2022] DELETE /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:20:01.490386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a716275c-7d99-4e87-8965-9077466b75d7 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Calling method '.version_select at 0x7f14963a0670>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:01.527398 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-a716275c-7d99-4e87-8965-9077466b75d7 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] HTTP exception thrown: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a716275c-7d99-4e87-8965-9077466b75d7 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Request method failure captured: Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 HTTP/1.1 Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXOfYzqITDsZQFQRGfW9h3NS_cPIxx5LMw58FKIJhDE767iOtz615nvRWbOihI7qpe8hVie4EBZwPBqx9Q8GVSabKsEc_XrLGrXhMnq9vu3LFqA6vvm6m-hTf-euklle1aX9irmQvCa9RG10zD-upjGK1ThTmd-Sfw46ZGNsbEPa-pg Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:20:01.529380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/894cff7b9106408bb865f52debd2b2dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_894cff7b9106408bb865f52debd2b2dd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/894cff7b9106408bb865f52debd2b2dd"}]}] Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 894cff7b9106408bb865f52debd2b2dd Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-863870653 Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 7c30caf193324cc88eadf14f82a74a57 Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-863870653-project Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'ad920a6a-f123-4f4c-99dd-3000e159a2a5'} Jun 24 08:20:01.532471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. (HTTP 404) (Request-ID: req-2a57374b-6036-4996-91fa-f052277fc3b8) Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.533729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:20:01.535034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:20:01.536362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a716275c-7d99-4e87-8965-9077466b75d7 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] Returning 404 to user: Volume ad920a6a-f123-4f4c-99dd-3000e159a2a5 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a716275c-7d99-4e87-8965-9077466b75d7 tempest-VolumesSnapshotsTestJSON-863870653 tempest-VolumesSnapshotsTestJSON-863870653-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5" status: 404 len: 109 microversion: 2.1 time: 0.044516 Jun 24 08:20:01.537878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 110/225] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:20:01 2022] GET /compute/v2.1/os-volumes/ad920a6a-f123-4f4c-99dd-3000e159a2a5 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:20:02.411214 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:02.411816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:02.418907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:02.419361 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:02.420228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:02.420640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:02.635574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:02.643979 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c511046e-8bab-4553-b1d5-951693831309 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.237223 Jun 24 08:20:02.644771 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 116/226] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:02 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:03.661248 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:03.661968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:03.671432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:03.673232 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:03.675797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:03.677623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:03.849424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:03.857492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0b20a3ee-b2b7-4a70-afb8-2a5fd44557ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.200383 Jun 24 08:20:03.858050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 111/227] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:03 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:04.874144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:04.874748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:04.881394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:04.881834 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:04.882583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:04.887908 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:05.020366 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:05.028386 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fd067b19-d95f-4f59-9bf7-292194003ce0 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1520 microversion: 2.1 time: 0.158602 Jun 24 08:20:05.029207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 117/228] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:04 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:06.046399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:06.047104 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:06.053962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:06.055068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:06.056080 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:06.056614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:06.211002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:06.220156 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e30aed2d-c5e4-4943-8563-318b965ec7e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1500 microversion: 2.1 time: 0.177236 Jun 24 08:20:06.221645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 112/229] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:06 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:06.239416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:06.240385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:06.249822 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:06.250662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:06.252115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:06.252681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:06.413118 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:06.421047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c11897c8-8fa0-4534-8bc6-4b1072d0d5e4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1515 microversion: 2.1 time: 0.186538 Jun 24 08:20:06.421619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:06 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:07.492560 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1076475071", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:07.550330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] validate_networks() for None {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:20:07.867230 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:20:07.868051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:20:07.868843 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:20:07.869299 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:20:07.869646 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:20:07.880498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:07.880951 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:07.881742 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:07.882444 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:07.902321 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Getting quotas for project 432ff4dfb4b240c097681d905c2dcc8f. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:07.911458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Getting quotas for user c699081f0e2249e2b9e36f6398aa4a88 and project 432ff4dfb4b240c097681d905c2dcc8f. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:07.924235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:20:07.931053 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:20:08.109736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ab150fb7-97aa-4ef2-85ae-b6bf93d5631e tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622246 Jun 24 08:20:08.111643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 113/231] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:20:08.121236 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-99e1c56a-ef39-4f71-860c-ef1339475a51 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:08.121840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-99e1c56a-ef39-4f71-860c-ef1339475a51 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:08.188109 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-99e1c56a-ef39-4f71-860c-ef1339475a51 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:08.200580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-99e1c56a-ef39-4f71-860c-ef1339475a51 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1215 microversion: 2.1 time: 0.083179 Jun 24 08:20:08.201902 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 119/232] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:08 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:08.322753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:08.323760 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:08.331105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:08.331548 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:08.332358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:08.332793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:08.359135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'flavor' on Instance uuid 1c224ed6-de35-4bae-a7c8-730721a700c0 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:20:08.671853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0f8cf37e-31cf-48e9-9504-7b3833848edd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/action" status: 200 len: 32 microversion: 2.1 time: 0.352911 Jun 24 08:20:08.672544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 114/233] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:20:08 2022] POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:20:08.682034 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:08.699914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:08.699914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:08.699914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:08.699914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:08.700554 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:08.869911 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:08.880415 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1b45b00a-e2da-48c5-b08d-daf048f251e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.202309 Jun 24 08:20:08.881123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 120/234] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:08 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:09.220280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-190237e7-a23d-4840-ad71-f0a3ff1d979d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:09.221291 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-190237e7-a23d-4840-ad71-f0a3ff1d979d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:09.280562 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-190237e7-a23d-4840-ad71-f0a3ff1d979d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:09.287897 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-190237e7-a23d-4840-ad71-f0a3ff1d979d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1215 microversion: 2.1 time: 0.073131 Jun 24 08:20:09.294364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 115/235] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:09 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:09.898245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:09.898881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:09.905797 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:09.906319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:09.907637 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:09.908075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:10.068593 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:10.076085 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1f3b0b60-3fd4-4075-ba8f-5011d9df8638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.181786 Jun 24 08:20:10.076871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:09 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:10.310175 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:10.310891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:10.318876 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:10.319516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:10.320408 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:10.320943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:10.392615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:10.401346 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4330639e-bdbc-4708-9bfe-7ff84f8b5b1b tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1211 microversion: 2.1 time: 0.095184 Jun 24 08:20:10.401915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 116/237] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:10 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:11.092955 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:11.093620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:11.100712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:11.101157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:11.101925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:11.102360 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:11.237880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:11.245430 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a47c8840-523c-489c-8e42-a74ed1e54e57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.156287 Jun 24 08:20:11.246003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:11 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:11.419215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:11.419820 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:11.435990 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:11.436729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:11.437884 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:11.438592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:11.537105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:11.545272 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0e9c2b11-8372-4c64-b851-f4dacc675d8d tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1275 microversion: 2.1 time: 0.130095 Jun 24 08:20:11.545866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 117/239] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:11 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:12.269691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:12.270921 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:12.277871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:12.278500 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:12.279371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:12.280298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:12.426408 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:12.435010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2c285103-597d-4175-9f11-1c4f106401a4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.170190 Jun 24 08:20:12.435587 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 123/240] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:12 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:12.564299 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:12.565504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:12.571777 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:12.572412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:12.573978 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:12.574575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:12.657201 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:12.666438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b45ca980-ae76-49c3-852b-28077ad0ad5f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1273 microversion: 2.1 time: 0.106784 Jun 24 08:20:12.667318 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 118/241] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:12 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:13.454339 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:13.455446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:13.475149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:13.475865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:13.477517 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:13.478066 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:13.684624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:13.685234 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:13.700859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:13.701518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:13.702455 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:13.703041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:13.865920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:13.877651 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-067644b8-23dc-4947-bf47-08a34b757a3a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.427497 Jun 24 08:20:13.878765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 124/242] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:13 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:13.957764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:13.965563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fd915b30-d772-464b-a684-74583ff607a1 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.285204 Jun 24 08:20:13.966317 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 119/243] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:13 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:14.895703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:14.896420 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:14.906813 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:14.907468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:14.908253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:14.908692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:14.983231 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:14.996043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:15.013469 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:15.013924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:15.014707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:15.018452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:15.154517 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:15.162905 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cf6aacff-e1ca-46de-b29a-b8333432363a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.271547 Jun 24 08:20:15.163496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 125/244] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:14 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:15.180606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-bf03da8b-8d2e-4c2d-9b92-be05085ec73b req-c7b973fb-9fbf-4e65-abef-c56c7ee3ad50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf67a242-90ce-46e4-a73d-85df21a649d1", "tag": "f33a0760-406c-4ba3-affc-6e423c52efbc"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:15.197103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-bf03da8b-8d2e-4c2d-9b92-be05085ec73b req-c7b973fb-9fbf-4e65-abef-c56c7ee3ad50 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:15.197849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-bf03da8b-8d2e-4c2d-9b92-be05085ec73b req-c7b973fb-9fbf-4e65-abef-c56c7ee3ad50 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:15.305298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:15.317165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5cc6fdd8-7a60-47e5-a026-9981e141c225 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.337958 Jun 24 08:20:15.336603 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 120/245] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:14 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:15.466900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-bf03da8b-8d2e-4c2d-9b92-be05085ec73b req-c7b973fb-9fbf-4e65-abef-c56c7ee3ad50 service nova] Creating event network-changed:f33a0760-406c-4ba3-affc-6e423c52efbc for instance bf67a242-90ce-46e4-a73d-85df21a649d1 on hv-cinder-83482 Jun 24 08:20:15.484810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-bf03da8b-8d2e-4c2d-9b92-be05085ec73b req-c7b973fb-9fbf-4e65-abef-c56c7ee3ad50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306221 Jun 24 08:20:15.485747 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 126/246] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:16.180258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:16.181456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:16.191211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:16.192577 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:16.193930 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:16.195563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:16.362073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:16.364466 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:16.374832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:16.380107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:16.380107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:16.380107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:16.503679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:16.514113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-94661f84-ec63-4f00-991b-3e12e1585d20 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.337748 Jun 24 08:20:16.515233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 121/247] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:16 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:16.639400 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:16.651846 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b3a2531c-b008-41b1-9c24-d4ce85140b8c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.308225 Jun 24 08:20:16.652505 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 127/248] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:16 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:17.540377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:17.540377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:17.544911 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:17.545518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:17.546392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:17.547065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:17.670151 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:17.670799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:17.680801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:17.681259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:17.682033 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:17.682464 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:17.890653 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:17.923588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:17.925016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-75bf072a-c4c0-4649-a081-e66d7b413800 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.393301 Jun 24 08:20:17.925596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 122/249] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:17 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:17.969328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:17.981799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d6c82403-db57-439e-85f1-54779647b7a4 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.316162 Jun 24 08:20:17.982467 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 128/250] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:17 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:18.943709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:18.944401 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:18.951220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:18.951984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:18.953028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:18.953551 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:18.999244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:19.000405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:19.008823 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:19.011482 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:19.012241 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:19.013483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:19.014228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:19.285970 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=8 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:19.301617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:19.324166 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:19.331804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-90352073-ed25-4169-87ee-176278348ca9 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.392929 Jun 24 08:20:19.348429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 123/251] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:18 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:19.366491 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-877b2931-d6fe-4f1d-92df-ae2731123941 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.371199 Jun 24 08:20:19.376620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 129/252] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:18 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:20.349773 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:20.350370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:20.363579 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:20.364331 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:20.365297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:20.365906 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:20.398308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:20.399898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:20.416170 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=56 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:20.439974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:20.442380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:20.443437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:20.444802 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:20.498817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:20.677094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:20.690866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-036cc248-f7b5-4dc3-a246-6363ae33741b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.345628 Jun 24 08:20:20.701049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 124/253] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:20 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:20.735793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:20.747826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f08e864e-bfbc-483a-8e1d-5e6019db4ced tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.357567 Jun 24 08:20:20.749176 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 130/254] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:20 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:21.668936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:21.670414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:21.679087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:21.679836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:21.682456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:21.683111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:21.708172 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:21.711055 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:21.743872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:21.744702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:21.745750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:21.748577 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:21.753438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-921a8ce7-0db0-4fc0-8691-f7d033432bef tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/ips" status: 200 len: 149 microversion: 2.1 time: 0.089318 Jun 24 08:20:21.755383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 125/255] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:20:21 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:21.767559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:21.769086 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:21.776138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:21.776991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:21.777971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:21.778892 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:22.057367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:22.067479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-85b21bd1-64d7-4b1a-84eb-c1399a7fad9c tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.306742 Jun 24 08:20:22.068071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 126/256] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:21 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:22.070229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:22.078011 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4e796e2e-e84f-4f1e-82ee-aff102c023bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.374044 Jun 24 08:20:22.079317 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 131/257] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:21 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:22.427543 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-5cb853bb-cf1c-412a-b362-b6793b925eea req-edb26356-b3a0-43e8-ad4b-64555a49e9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf67a242-90ce-46e4-a73d-85df21a649d1", "name": "network-vif-plugged", "status": "completed", "tag": "f33a0760-406c-4ba3-affc-6e423c52efbc"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:22.437861 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-5cb853bb-cf1c-412a-b362-b6793b925eea req-edb26356-b3a0-43e8-ad4b-64555a49e9f9 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:22.439112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-5cb853bb-cf1c-412a-b362-b6793b925eea req-edb26356-b3a0-43e8-ad4b-64555a49e9f9 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:22.452695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-5cb853bb-cf1c-412a-b362-b6793b925eea req-edb26356-b3a0-43e8-ad4b-64555a49e9f9 service nova] Creating event network-vif-plugged:f33a0760-406c-4ba3-affc-6e423c52efbc for instance bf67a242-90ce-46e4-a73d-85df21a649d1 on hv-cinder-83482 Jun 24 08:20:22.458222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-5cb853bb-cf1c-412a-b362-b6793b925eea req-edb26356-b3a0-43e8-ad4b-64555a49e9f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036527 Jun 24 08:20:22.459887 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 127/258] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:23.086106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:23.086632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:23.093489 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:23.094248 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:23.095776 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:23.096392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:23.098301 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:23.099205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:23.107062 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:23.107826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:23.108866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:23.109501 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:23.114764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:23.441958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:23.446525 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:23.451395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f18e69f9-4f88-46d8-99e8-a128a1eb9028 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.368640 Jun 24 08:20:23.452794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 132/259] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:23 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:23.460862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c571cd3f-e5c7-44f8-a933-f5fc4a455d5b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.367748 Jun 24 08:20:23.473197 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 128/260] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:23 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:23.800434 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3d97859-c807-43ae-aeb7-2099b17f47e2"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:23.801822 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:23.808311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:23.809099 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:23.810029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:23.810616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.332599 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:24.333125 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:24.340072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:24.340626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.341413 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:24.342020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.368111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2690a559-ea85-4450-a8d6-f06d092cedfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/ips" status: 200 len: 144 microversion: 2.1 time: 0.039559 Jun 24 08:20:24.368940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 129/261] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:20:24 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:24.472182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:24.474156 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:24.485141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:24.485837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.486980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:24.487629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.740589 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:24.750466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2413e2be-ef72-4534-8615-e70fc4d9b5fb tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1315 microversion: 2.1 time: 0.283967 Jun 24 08:20:24.752595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 130/262] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:24 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:24.758528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:24.759383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:24.770430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:24.773350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.773460 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:24.773868 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:24.982257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:24.992469 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8496a49e-aa1d-4a22-b021-2fdbf49749d7 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.238616 Jun 24 08:20:24.993924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 131/263] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:24 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:25.159922 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-320e27eb-75d8-4e97-b96b-3346a4423cf4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.363430 Jun 24 08:20:25.160595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 133/264] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:20:23 2022] POST /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments => generated 194 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:20:25.771822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:25.772690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:25.793241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:25.793710 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:25.794498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:25.796189 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:25.989820 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:26.000508 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bd6f0226-e81f-46fa-9fea-de0582aaad70 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1465 microversion: 2.1 time: 0.235440 Jun 24 08:20:26.002070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 132/265] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:25 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1465 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:26.017460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:26.018270 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:26.033449 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.033449 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.034060 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.034495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.285603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:26.296781 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-75985f02-8a99-4b65-8cce-d508d9046aad tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.285125 Jun 24 08:20:26.297452 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 134/266] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:26 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:26.303423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:26.303910 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:26.311078 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.311466 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.312253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.312686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.348038 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:20:26.368982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-385418f2-a8df-48f0-8f19-453a5a31d83b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Action: 'create', calling method: .version_select at 0x7f14963a0940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1900007784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJcrXdBofKoEDj/vZT4QN29i92AIaXgQ6XanfH44APkrJ5e0RZvK1rLfjrJBOkNy2iAcN5m8ZTryrbq3IMevy7r01P3L4Fx7YxTKLEbvokzBgSAOr48w4WdpxxqayIW/g=="}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:26.389484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-385418f2-a8df-48f0-8f19-453a5a31d83b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:26.390335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-385418f2-a8df-48f0-8f19-453a5a31d83b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for user 01fe8c57517d4ca5958ec13139aa2b74 and project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:26.500274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-385418f2-a8df-48f0-8f19-453a5a31d83b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.462893 Jun 24 08:20:26.502158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 133/267] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:20:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:26.510987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:26.511717 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:26.519912 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.520566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.521333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.521756 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.551770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6cf2666f-64c6-4331-83b0-a264fc1884bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/ips" status: 200 len: 151 microversion: 2.20 time: 0.048236 Jun 24 08:20:26.552364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 134/268] 10.222.0.42 () {60 vars in 1288 bytes} [Fri Jun 24 08:20:26 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:20:26.743410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6b416aec-2eab-4f2d-af64-60cb36257145 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 204 len: 0 microversion: 2.1 time: 0.443369 Jun 24 08:20:26.746024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 135/269] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:20:26 2022] DELETE /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:20:26.754124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:26.754759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:26.760901 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.761345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.762236 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:26.762663 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:26.937426 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:26.945424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6684e6a0-d830-4f6f-8963-24050fee42fc tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1471 microversion: 2.1 time: 0.196554 Jun 24 08:20:26.946030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 135/270] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:26 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:27.315508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:27.316251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:27.322594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:27.323058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:27.323886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:27.324356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:27.499883 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:27.510924 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f2938396-8595-4ad7-aed6-315b498dea60 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.199627 Jun 24 08:20:27.516382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 136/271] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:27 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:27.962984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:27.964621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:27.972558 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:27.982124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:27.982124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:27.984648 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:28.091952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a34786a5-318e-4cbd-a292-6b30f03bd447"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:28.093115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:28.113266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:28.113915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:28.114855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:28.115481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:28.157254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:28.190598 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ffc2e7c4-979d-4435-a4a6-b9ef8aa50dcd tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1471 microversion: 2.1 time: 0.231373 Jun 24 08:20:28.191286 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 136/272] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:27 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:28.529688 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:28.530458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:28.533012 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:28.538810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:28.539514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:28.540475 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:28.541176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:28.773115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:28.782862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-939a999a-dde6-4829-adf0-7887f0125ad1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.258286 Jun 24 08:20:28.783694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 137/273] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:28 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:29.208632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:29.209370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:29.216675 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:29.217209 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:29.217890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:29.218319 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:29.278772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-eab6e491-70ee-4fd4-ab53-891f590e0cda tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.190630 Jun 24 08:20:29.293354 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 137/274] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:20:28 2022] POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:29.323580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-8ffc4bbc-a4c4-4d6a-beac-080d4e1c6df8 req-c5c23504-f2f6-4824-8698-1817fb05c521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf67a242-90ce-46e4-a73d-85df21a649d1", "name": "network-vif-deleted", "tag": "f33a0760-406c-4ba3-affc-6e423c52efbc"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:29.342238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-8ffc4bbc-a4c4-4d6a-beac-080d4e1c6df8 req-c5c23504-f2f6-4824-8698-1817fb05c521 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:29.342982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-8ffc4bbc-a4c4-4d6a-beac-080d4e1c6df8 req-c5c23504-f2f6-4824-8698-1817fb05c521 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:29.391146 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-8ffc4bbc-a4c4-4d6a-beac-080d4e1c6df8 req-c5c23504-f2f6-4824-8698-1817fb05c521 service nova] Creating event network-vif-deleted:f33a0760-406c-4ba3-affc-6e423c52efbc for instance bf67a242-90ce-46e4-a73d-85df21a649d1 on hv-cinder-83482 Jun 24 08:20:29.414203 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:29.424772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0b83c3db-6113-43dc-95e3-3cba2feb89b5 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1429 microversion: 2.1 time: 0.220300 Jun 24 08:20:29.430883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 138/275] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:29 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1429 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:29.462109 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-8ffc4bbc-a4c4-4d6a-beac-080d4e1c6df8 req-c5c23504-f2f6-4824-8698-1817fb05c521 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142449 Jun 24 08:20:29.468153 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 138/276] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:20:29.801079 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:29.801878 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:29.808724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:29.813318 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:29.813318 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:29.813318 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:29.962276 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:29.972178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-10e4c090-11dc-410a-beeb-ea6a86748638 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.175775 Jun 24 08:20:29.972799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 139/277] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:29 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:30.454586 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:30.454586 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:30.455200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.455661 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:30.456455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.456891 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:30.491749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.492413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:30.493014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lazy-loading 'fault' on Instance uuid bf67a242-90ce-46e4-a73d-85df21a649d1 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:20:30.537575 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:30.551130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fa1f1aa8-565d-4e25-91cb-03064c9df143 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1305 microversion: 2.1 time: 0.103215 Jun 24 08:20:30.551130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 139/278] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:30 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:30.639535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:30.639535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:30.643435 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.643879 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:30.644672 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.645134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:30.668377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lazy-loading 'flavor' on Instance uuid e2ac85cf-1104-4227-867c-51b136c5de24 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:20:30.990246 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:30.990925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:30.997806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.998271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:30.999041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:30.999513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:31.130906 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:31.138387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ad7e9ba4-f3c5-4658-99c3-295ee987772e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.153099 Jun 24 08:20:31.138951 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 140/279] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:30 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:31.514178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a7aeddc0-e48f-4bc1-aefa-204ea8cdbf85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/action" status: 202 len: 0 microversion: 2.20 time: 0.881793 Jun 24 08:20:31.514787 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 140/280] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 24 08:20:30 2022] POST /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:20:31.523135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:31.523747 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:31.531184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:31.531626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:31.532931 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:31.533367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:31.574350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:31.577130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:31.606530 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:31.607082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:31.609967 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:31.611205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:31.647636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:31.648332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:31.648804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lazy-loading 'fault' on Instance uuid bf67a242-90ce-46e4-a73d-85df21a649d1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:20:31.704837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:31.713751 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3c4329b5-afa7-4431-bade-0de2a5d9273f tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1305 microversion: 2.1 time: 0.150149 Jun 24 08:20:31.723122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:31.724287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 141/281] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:31 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1305 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:31.731812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:31.733435 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:31.734622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ff78096c-712e-4058-b50a-7788a9a062fa tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.215410 Jun 24 08:20:31.735171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 141/282] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:31 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:32.162063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:32.162694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:32.168696 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.169184 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.169933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.170623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.300716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:32.308098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9d781996-4325-4583-aa1f-c1df162b152d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.151140 Jun 24 08:20:32.308684 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 142/283] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:32 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:32.730739 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:32.731346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:32.738420 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.738863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.739811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.740264 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.754066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:32.754764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:32.760694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.761135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.761943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.762322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.772769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:32.773210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:32.773650 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lazy-loading 'fault' on Instance uuid bf67a242-90ce-46e4-a73d-85df21a649d1 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:20:32.826000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c699081f0e2249e2b9e36f6398aa4a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432ff4dfb4b240c097681d905c2dcc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:32.830430 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:32.834917 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9609d12b-8d3b-439b-884a-8bf1adebe1f2 tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 200 len: 1305 microversion: 2.1 time: 0.107840 Jun 24 08:20:32.844507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 142/284] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:32 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:32.909541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:32.917549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:32.919054 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:32.920222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-317e4ffd-2630-4322-9625-3ac57ffe22a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.171110 Jun 24 08:20:32.920773 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 143/285] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:32 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:20:33.327059 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:33.327657 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:33.334457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:33.335076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:33.335827 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:33.336281 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:33.472467 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:33.482562 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-06abd263-e1a1-443b-93d4-4b9bb8095c37 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.159580 Jun 24 08:20:33.483204 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 143/286] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:33 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:33.851792 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:33.852531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] [instance: bf67a242-90ce-46e4-a73d-85df21a649d1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:33.859629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:33.860073 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:33.860869 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:33.861391 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:33.865629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:33.877038 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] HTTP exception thrown: Instance bf67a242-90ce-46e4-a73d-85df21a649d1 could not be found. Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Request method failure captured: Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 HTTP/1.1 Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXO1GqobEIzTJ346TI8HtzjgZRiDVALfJfSvTIW-JdBNTFaN6kQ8ggfxkYv56xdNxJGZR0H2201d90Pr1vZpu9nkXLZmF01kX_8K-ZWUNhd9ChqBn6xK40fuz1LC5Xop-ZHG0lxb6eNb6ljmfyFpAekEQZMx1cSiwRyNXBfEcOrMAXI Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 432ff4dfb4b240c097681d905c2dcc8f Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesNegativeTest-1848647403 Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:20:33.879026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432ff4dfb4b240c097681d905c2dcc8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/432ff4dfb4b240c097681d905c2dcc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_432ff4dfb4b240c097681d905c2dcc8f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432ff4dfb4b240c097681d905c2dcc8f"}]}] Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesNegativeTest-1848647403 Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 432ff4dfb4b240c097681d905c2dcc8f Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesNegativeTest-1848647403 Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesNegativeTest-1848647403-project Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: c699081f0e2249e2b9e36f6398aa4a88 Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesNegativeTest-1848647403-project Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance bf67a242-90ce-46e4-a73d-85df21a649d1 could not be found. Jun 24 08:20:33.880697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'bf67a242-90ce-46e4-a73d-85df21a649d1'} Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf67a242-90ce-46e4-a73d-85df21a649d1 could not be found. Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:20:33.881593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf67a242-90ce-46e4-a73d-85df21a649d1 could not be found. Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf67a242-90ce-46e4-a73d-85df21a649d1 could not be found. Jun 24 08:20:33.882962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:33.884216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] Returning 404 to user: Instance bf67a242-90ce-46e4-a73d-85df21a649d1 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:20:33.884216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-905d01a4-48c2-4c21-9263-d8de56c8504a tempest-VolumesNegativeTest-1848647403 tempest-VolumesNegativeTest-1848647403-project] 10.222.0.42 "GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1" status: 404 len: 111 microversion: 2.1 time: 0.032779 Jun 24 08:20:33.884216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 144/287] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:33 2022] GET /compute/v2.1/servers/bf67a242-90ce-46e4-a73d-85df21a649d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:20:33.940019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:33.947750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:33.947750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:33.947750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:33.948546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:33.948969 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:34.085783 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:34.094280 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:34.096405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:34.097558 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b01c4a22-c7ef-4ddc-baf1-25be664e8be8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.162385 Jun 24 08:20:34.098115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 144/288] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:33 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:34.499440 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:34.504034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:34.511694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:34.512135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:34.512930 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:34.513358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:34.659433 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:34.668420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f7ed22b9-7bf9-4ea3-bb60-f788cd40c207 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.172887 Jun 24 08:20:34.668986 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 145/289] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:34 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:35.117614 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:35.118848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:35.126648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:35.127102 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:35.128030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:35.128518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:35.279665 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:35.291445 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:35.293009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:35.294496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-430cb300-805c-42d3-858a-a87fc9ad0d67 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.182266 Jun 24 08:20:35.305522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 145/290] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:35 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:35.685608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:35.688133 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:35.696618 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:35.697063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:35.697815 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:35.698240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:35.867296 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:35.876482 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-afe0a86e-8be7-49ac-a048-b234492145bc tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.194383 Jun 24 08:20:35.877512 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 146/291] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:35 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:36.312821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:36.314383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:36.321983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:36.322487 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:36.323589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:36.324029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:36.475284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:36.475522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-777e06ca-7eb9-4473-bd42-b45598d107ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: .version_select at 0x7f14963263a0>, body: {"keypair": {"name": "tempest-keypair-1145702587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJScaai8S96GEtO9lCxvUGZ+pB/BgCFIUUGbdvsrTCkjteIVtERs5OkR+uF5By8oqdB/RDIjMQb1q8nV6t5HDugcEu9oHkLllC3HPhmwEfUMi6ftJLAY4aiNIOGiyTPF9g=="}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:36.479370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:36.484372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:36.486771 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:36.487932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9a55dcc9-230e-40f2-a910-a0f57f8ceab7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.179193 Jun 24 08:20:36.488535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 146/292] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:36 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:36.490703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-777e06ca-7eb9-4473-bd42-b45598d107ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:36.494504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-777e06ca-7eb9-4473-bd42-b45598d107ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:36.613464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-777e06ca-7eb9-4473-bd42-b45598d107ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141948 Jun 24 08:20:36.614414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 147/293] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:20:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:20:36.895384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:36.896155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:36.903723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:36.904532 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:36.906379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:36.908722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:37.064592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:37.072297 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-83a2910e-3b8c-4749-b3f3-597b68c3836e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.183846 Jun 24 08:20:37.072860 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 147/294] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:36 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:37.509355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:37.510472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:37.517464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:37.518125 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:37.519275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:37.519707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:37.675519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:37.683420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:37.685240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:37.686367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1f22bca2-7f88-4639-bbbc-e38b840a283b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.181446 Jun 24 08:20:37.686908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 148/295] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:37 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:38.089785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:38.090384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:38.097089 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.097568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.098318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.098746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.246200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:38.259563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-661de169-d748-4bf6-b991-22215b413c52 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1501 microversion: 2.1 time: 0.173340 Jun 24 08:20:38.260216 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 148/296] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:38 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:38.282977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45b33f5f-6a7e-4778-855d-922209a5ba35"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:38.282977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:38.287778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.288270 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.289140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.289645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.314642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] HTTP exception thrown: Cannot 'attach_volume' instance 1c224ed6-de35-4bae-a7c8-730721a700c0 while it is in vm_state rescued Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Request method failure captured: Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/os-volume_attachments HTTP/1.1 Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 74 Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNZBwTmdq5yAzMMjF96X7yeJ3d8jP1znACExJ4UN2fZLT3CsTKbSXox-XyNtrUxZ57VcL_BBgmhIYr5PzBAiI2iBNP8gjGURsnmqAb6w_gkRFw5xKpLgJhQclVWQs5Yf5UzOEvgX6-fqxq6v_iNcYqeyfWat8p4cr7Zm-UjUuCbS1o Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:20:38.316436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e79436f86e1e4038a7b0e41cf468bb62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}] Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 5ebbd67cca66411ea52e4b92478564cf Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {"volumeAttachment": {"volumeId": "45b33f5f-6a7e-4778-855d-922209a5ba35"}} Jun 24 08:20:38.320960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Cannot 'attach_volume' instance 1c224ed6-de35-4bae-a7c8-730721a700c0 while it is in vm_state rescued Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'server_id': '1c224ed6-de35-4bae-a7c8-730721a700c0', 'body': {'volumeAttachment': {'volumeId': '45b33f5f-6a7e-4778-855d-922209a5ba35'}}} Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:20:38.321889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1c224ed6-de35-4bae-a7c8-730721a700c0 while it is in vm_state rescued Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:20:38.323192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1c224ed6-de35-4bae-a7c8-730721a700c0 while it is in vm_state rescued Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Returning 409 to user: Cannot 'attach_volume' instance 1c224ed6-de35-4bae-a7c8-730721a700c0 while it is in vm_state rescued {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3a8c1dd6-3d5a-4a57-8a1d-4fb5e9ba4a58 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045507 Jun 24 08:20:38.324778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 149/297] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:20:38 2022] POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:20:38.332734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:38.333272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:38.339473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.339940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.345726 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.345726 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.598594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c41dc5ba-bd56-43b1-8c11-fc6a27960f7f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/action" status: 202 len: 0 microversion: 2.1 time: 0.271692 Jun 24 08:20:38.602343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 149/298] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:20:38 2022] POST /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:20:38.609521 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:38.610153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:38.616693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.617140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.618138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.618740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.704774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:38.705696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:38.717437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.719010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.719880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:38.720490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:38.841488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:38.855392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-83ee2c2e-1085-46aa-82fd-6f49b3ee55bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1509 microversion: 2.1 time: 0.249954 Jun 24 08:20:38.855966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 150/299] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:38 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:38.913082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:38.922079 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:38.925380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:38.927200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a6513e7e-77dd-422a-acf6-d470012c4585 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.226429 Jun 24 08:20:38.928245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 150/300] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:38 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:20:39.873466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:39.873997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:39.880700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:39.881153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:39.881905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:39.882433 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:39.956475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:39.957784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:39.964930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:39.965396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:39.966165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:39.966603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:40.183003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:40.195213 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:40.196749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:40.197909 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-441efa50-0d75-456b-901c-46e998d9022d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.254999 Jun 24 08:20:40.198465 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 151/301] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:39 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:40.203282 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-492929887", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7"}], "security_groups": [{"name": "tempest-securitygroup--2037299893"}], "key_name": "tempest-keypair-1145702587", "user_data": "}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:40.214996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:40.223559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ad7166ba-b019-4d10-a720-8933c24352ed tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1509 microversion: 2.1 time: 0.354059 Jun 24 08:20:40.224536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 151/302] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:39 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:40.321606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] validate_networks() for [('be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:20:40.727910 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:20:40.728396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:20:40.729057 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:20:40.729462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:20:40.730082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:20:40.746784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:40.747419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:40.748276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:40.748717 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:40.767952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:40.772144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:40.784370 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:20:40.786777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:20:40.968898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b53eb01b-a2ed-4916-ac65-7fa36d72143d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.769399 Jun 24 08:20:40.969574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 152/303] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:20:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:20:40.980984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2cf7b1f0-ccb7-4b3e-8b00-f6d54e299120 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:40.981593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2cf7b1f0-ccb7-4b3e-8b00-f6d54e299120 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:41.082852 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2cf7b1f0-ccb7-4b3e-8b00-f6d54e299120 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:41.108071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2cf7b1f0-ccb7-4b3e-8b00-f6d54e299120 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1241 microversion: 2.1 time: 0.131327 Jun 24 08:20:41.119458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 152/304] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:40 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:41.216903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:41.217736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:41.226409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:41.227478 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:41.228545 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:41.229128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:41.244044 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:41.244836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:41.252660 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:41.253573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:41.254752 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:41.255438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:41.482072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:41.496705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:41.499870 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:41.504326 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f9cb4e2e-d18c-4c72-b76f-a6918716b871 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.291794 Jun 24 08:20:41.516808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 153/305] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:41 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:20:41.520540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:41.528507 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e534d983-d2bb-4e3c-bebc-cf173ff2566b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1509 microversion: 2.1 time: 0.290014 Jun 24 08:20:41.531759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 153/306] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:41 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:42.126131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:42.127693 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:42.135115 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:42.135890 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:42.136566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:42.137006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:42.222260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:42.246613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cf58b555-0f16-47d9-8a2b-a77b373a74d3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1245 microversion: 2.1 time: 0.123113 Jun 24 08:20:42.258439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 154/307] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:42 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:42.534784 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:42.541083 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:42.541664 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:42.542118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:42.542971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:42.548595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:42.548825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:42.549637 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:42.557473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:42.558227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:42.561883 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:42.562756 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:42.769897 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:42.774259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:42.777934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:42.779588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:42.780809 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d2bfa277-a8c0-4837-af57-18c4c88da5b8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.250190 Jun 24 08:20:42.781409 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 154/308] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:42 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:42.782877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2ff0521b-2b5c-4ab6-8969-e7f323a21af1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1515 microversion: 2.1 time: 0.238108 Jun 24 08:20:42.783555 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 155/309] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:42 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:43.278211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:43.290315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:43.290315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:43.290315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:43.290821 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:43.291358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:43.355754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:43.363428 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3915b759-9763-49a9-b336-054e8163276a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1245 microversion: 2.1 time: 0.092059 Jun 24 08:20:43.363984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 155/310] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:43 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:43.800027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:43.800706 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:43.808262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:43.808721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:43.809745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:43.810353 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:43.980765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:43.989318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:43.990819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:43.991966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-95d9e93a-fdfd-4d96-8463-5cd6ce293b10 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.196808 Jun 24 08:20:43.992575 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 156/311] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:43 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:44.381697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:44.382794 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:44.390099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:44.390554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:44.391554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:44.392737 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:44.459040 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:44.466541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-af1dba57-83d7-42e3-8e97-76b8bfd982ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1245 microversion: 2.1 time: 0.090273 Jun 24 08:20:44.467089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 156/312] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:44 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:44.728378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-04fed7b6-bfc4-4de4-bf21-6fff3e1738c1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'create', calling method: .version_select at 0x7f14963579d0>, body: {"keypair": {"name": "tempest-keypair-1203928592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcRyVuxOkl2BjFpfXz3xYh80/Kg4KGyf3VOWs2zKKNMky2w4QrVJe3VCX9065bTiiRQjrFv8MBtHIOCqqtMeIf5e1lXh3X+9Yki8XXSiezFQa+QjUlZttzZGzw3k/wuKw=="}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:44.742464 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-04fed7b6-bfc4-4de4-bf21-6fff3e1738c1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:44.747330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-04fed7b6-bfc4-4de4-bf21-6fff3e1738c1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for user 5ebbd67cca66411ea52e4b92478564cf and project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:44.889181 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-04fed7b6-bfc4-4de4-bf21-6fff3e1738c1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162490 Jun 24 08:20:44.889181 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 157/313] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:20:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:45.010587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:45.011208 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:45.017661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:45.018548 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:45.019333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:45.019771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:45.409981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:45.418260 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:45.420217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:45.421407 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4b0241ba-7c03-45c6-bd4a-88c6b47c711e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.414908 Jun 24 08:20:45.421910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 157/314] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:45 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:20:45.488234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:45.489003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:45.497062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:45.497347 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:45.498350 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:45.498826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:45.566891 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:45.573689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b01302d6-19ee-44d6-8ea9-f88afff9ca5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1245 microversion: 2.1 time: 0.091342 Jun 24 08:20:45.574360 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 158/315] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:45 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:46.439300 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:46.439905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:46.446604 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:46.447045 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:46.451934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:46.451934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:46.592604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:46.594273 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:46.601906 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:46.602642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:46.604392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:46.605074 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:46.642608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:46.653481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:46.659668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:46.661073 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8fd6de9b-b0e3-4176-b005-b2bc55397750 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.225732 Jun 24 08:20:46.662035 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 158/316] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:46 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:46.716743 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:46.746543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ea8f971b-474d-493d-9153-670fb2aba288 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1245 microversion: 2.1 time: 0.157452 Jun 24 08:20:46.748223 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 159/317] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:46 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:47.682485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:47.683099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:47.690114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:47.690975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:47.691748 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:47.692175 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:47.766022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:47.767998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:47.774564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:47.775012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:47.775916 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:47.776396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:47.781342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:47.858021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:47.861603 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:47.865780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-64695c26-3c3a-4238-a1af-e3b9e3026e5e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1245 microversion: 2.1 time: 0.103998 Jun 24 08:20:47.866356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 160/318] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:47 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:47.869933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:47.871437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:47.872606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ae0d67c8-5e28-480e-bde8-73455b88790c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.196244 Jun 24 08:20:47.873141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 159/319] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:47 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:48.409011 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-511132433", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99d769cf-78c9-4625-a069-73c6a05c7529"}], "security_groups": [{"name": "tempest-securitygroup--379296115"}], "key_name": "tempest-keypair-1203928592", "user_data": "}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:48.507674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] validate_networks() for [('99d769cf-78c9-4625-a069-73c6a05c7529', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:20:48.706171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:48.883017 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:48.883797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:48.890048 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:48.890572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:48.891340 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:48.891863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:48.908035 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:20:48.908686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:20:48.909235 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:20:48.909710 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:20:48.910188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:20:48.919363 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:48.921529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:48.921529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:48.921529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:48.939252 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:48.943048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Getting quotas for user 5ebbd67cca66411ea52e4b92478564cf and project e79436f86e1e4038a7b0e41cf468bb62. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:48.954238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:20:48.956374 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:20:48.959698 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:48.980823 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6dc225cc-a451-44fd-a30b-36c0b2f13ba6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1293 microversion: 2.1 time: 0.101565 Jun 24 08:20:48.992159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 160/320] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:48 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:48.993258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:48.993862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:48.999911 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:49.000381 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:49.001369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:49.001369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:49.122233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f3fb64d6-6e13-4c2d-9a2a-0cf841381d17 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.717902 Jun 24 08:20:49.124362 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 161/321] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:20:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:20:49.138144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4b842ec4-d42a-43b2-bd01-d02aecb4ad39 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:49.139243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4b842ec4-d42a-43b2-bd01-d02aecb4ad39 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:49.190770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:49.199304 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:49.200987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:49.202233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f8ec15cf-4dee-4c2b-b8b6-1f51f73baad2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1745 microversion: 2.20 time: 0.212777 Jun 24 08:20:49.202894 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 161/322] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:48 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1745 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:49.221343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4b842ec4-d42a-43b2-bd01-d02aecb4ad39 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:49.228506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4b842ec4-d42a-43b2-bd01-d02aecb4ad39 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1245 microversion: 2.1 time: 0.096933 Jun 24 08:20:49.229448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 162/323] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:49 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:49.741812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-524589499", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "networks": [{"uuid": "96a4491d-88f3-4f8d-8921-4250acd08643"}]}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:49.816681 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] validate_networks() for [('96a4491d-88f3-4f8d-8921-4250acd08643', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:20:49.907958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b1b9c2ed-d883-401b-b3fc-40dbe23790d1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:49.917136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b1b9c2ed-d883-401b-b3fc-40dbe23790d1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:49.918469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b1b9c2ed-d883-401b-b3fc-40dbe23790d1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:49.987518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b1b9c2ed-d883-401b-b3fc-40dbe23790d1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Going to try to stop instance {{(pid=118296) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 08:20:50.204821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b1b9c2ed-d883-401b-b3fc-40dbe23790d1 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action" status: 202 len: 0 microversion: 2.1 time: 0.300895 Jun 24 08:20:50.206645 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 163/324] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:20:49 2022] POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:20:50.213376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:50.214323 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:50.215524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:20:50.217105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:20:50.217812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:20:50.218423 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:20:50.220190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:20:50.223846 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.224348 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.225511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.226187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.232066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.232679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.233542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.234018 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.259036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Getting quotas for project dae6efd4ad46479cb965caa8a97a772a. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:50.263582 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Getting quotas for user 69533891e4cf463bb3fe9ac5cf7f4215 and project dae6efd4ad46479cb965caa8a97a772a. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:50.281388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:20:50.281388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:20:50.394599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.402571 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c251dbb5-6121-4212-ad3e-5d18d96fdeab tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.194126 Jun 24 08:20:50.403202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 164/325] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:50 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:50.416293 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a5cc02cb-d4ee-4a3b-b94c-f5c44053cf20 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678340 Jun 24 08:20:50.423111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 162/326] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:20:50.430828 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:50.431278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:50.431423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:50.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:50.438136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.439481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.440229 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.440707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.441024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.441607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.441722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.442144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.677808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.689642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7e74d994-8676-4374-b7aa-9db96eaab7fa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.285229 Jun 24 08:20:50.690937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 165/327] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:50 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:50.692388 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.696964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:50.697634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:50.704388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.704895 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.705725 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:50.706164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:50.706360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.708245 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.709616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c969d1b7-0863-45eb-8baa-91bdbad582ed tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1745 microversion: 2.20 time: 0.285124 Jun 24 08:20:50.710343 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 163/328] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:50 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1745 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:50.715756 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-223d1192-61c7-4254-9fad-6c993e0e9b26 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:50.716753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-223d1192-61c7-4254-9fad-6c993e0e9b26 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:50.797553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-223d1192-61c7-4254-9fad-6c993e0e9b26 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.810980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-223d1192-61c7-4254-9fad-6c993e0e9b26 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1218 microversion: 2.1 time: 0.099353 Jun 24 08:20:50.821572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 164/329] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:50 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:50.834724 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:50.847141 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2bb7c3bb-9d14-459c-82c3-6b698c676aa6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1249 microversion: 2.1 time: 0.151838 Jun 24 08:20:50.847908 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 166/330] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:50 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1249 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:50.914145 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2100965337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1900007784", "security_groups": [{"name": "tempest-secgroup-smoke-1452156496"}], "block_device_mapping_v2": [{"uuid": "ff9283b9-e81a-4f4f-8c1c-106a8e44b6a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b69c08d-6a46-414d-bcd2-12cdadfd6edc"}]}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:51.037578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] validate_networks() for [('7b69c08d-6a46-414d-bcd2-12cdadfd6edc', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:20:51.141738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-e0e0f15a-e909-4589-8a0c-172d3258c88f req-e83b3484-8ad7-45bc-89db-47d51c9bae78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "name": "network-vif-plugged", "status": "completed", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:51.150627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e0e0f15a-e909-4589-8a0c-172d3258c88f req-e83b3484-8ad7-45bc-89db-47d51c9bae78 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.151195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e0e0f15a-e909-4589-8a0c-172d3258c88f req-e83b3484-8ad7-45bc-89db-47d51c9bae78 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.163056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-e0e0f15a-e909-4589-8a0c-172d3258c88f req-e83b3484-8ad7-45bc-89db-47d51c9bae78 service nova] Creating event network-vif-plugged:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:20:51.168351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-e0e0f15a-e909-4589-8a0c-172d3258c88f req-e83b3484-8ad7-45bc-89db-47d51c9bae78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 Jun 24 08:20:51.169767 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 167/331] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:20:51.421527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:51.423949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:51.432406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.432406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.432793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.433222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.449302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:20:51.449882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:20:51.450209 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:20:51.450615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:20:51.451022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:20:51.460682 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.461124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.461913 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.462342 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.489410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:20:51.493813 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for user 01fe8c57517d4ca5958ec13139aa2b74 and project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:20:51.565107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:20:51.567351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff9283b9-e81a-4f4f-8c1c-106a8e44b6a0',volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:20:51.581662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:51.590279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e92b04c4-319c-4616-b97c-cfd60a26aa6c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.172910 Jun 24 08:20:51.590854 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 168/332] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:51 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:51.623407 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-0bba98a0-f60d-4fc6-99cf-58885135da04 req-605a660a-5e40-4af6-9b45-aa41010471ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25911a0-62f3-4ceb-8e93-5a492c985fae", "tag": "88e3b09c-5211-435b-a4f7-a0439b4d71c3"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:51.633214 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-0bba98a0-f60d-4fc6-99cf-58885135da04 req-605a660a-5e40-4af6-9b45-aa41010471ea service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.633992 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-0bba98a0-f60d-4fc6-99cf-58885135da04 req-605a660a-5e40-4af6-9b45-aa41010471ea service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.647006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-0bba98a0-f60d-4fc6-99cf-58885135da04 req-605a660a-5e40-4af6-9b45-aa41010471ea service nova] Creating event network-changed:88e3b09c-5211-435b-a4f7-a0439b4d71c3 for instance c25911a0-62f3-4ceb-8e93-5a492c985fae on hv-cinder-83482 Jun 24 08:20:51.653748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-0bba98a0-f60d-4fc6-99cf-58885135da04 req-605a660a-5e40-4af6-9b45-aa41010471ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 Jun 24 08:20:51.655104 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 169/333] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:51.707690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:51.708601 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:51.715423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.715964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.716847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.717354 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.894762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:51.903228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d28880c0-2248-47de-b4f8-ce31fb8eebe9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.199719 Jun 24 08:20:51.903889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 170/334] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:51 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:51.909332 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:51.910118 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:51.916306 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.916831 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:51.917683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:51.918185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.020808 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:52.072596 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.081980 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.083822 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.085158 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-829f94bc-6315-4053-af73-187cee8bc922 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.180257 Jun 24 08:20:52.085788 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 171/335] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:51 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:52.090939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:52.092355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:52.099832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.100393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.101544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.101915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.175535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.191225 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1be2abd5-4fc7-4db1-9319-0e0a0a26a0b1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1222 microversion: 2.1 time: 0.104151 Jun 24 08:20:52.192690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 172/336] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:52 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:52.199414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:52.200918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:52.210582 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.211587 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.212645 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.213308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.258051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bf6238e2-c350-4841-948a-9669315c4654 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.345306 Jun 24 08:20:52.261754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 165/337] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:20:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:20:52.289227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9237cf03-e641-4148-9ff2-b11e25c8b443 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:52.290143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9237cf03-e641-4148-9ff2-b11e25c8b443 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:52.349377 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.358629 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cc501407-e03e-4348-a0b1-fd658d8e455d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1305 microversion: 2.1 time: 0.164657 Jun 24 08:20:52.368356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 173/338] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:52 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1305 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:52.382254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9237cf03-e641-4148-9ff2-b11e25c8b443 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.391317 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9237cf03-e641-4148-9ff2-b11e25c8b443 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1095 microversion: 2.1 time: 0.121939 Jun 24 08:20:52.393180 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 166/339] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:52 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:52.611417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:52.611991 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:52.621721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.622640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.623818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.624808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.819041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:52.826527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7ee8dff0-f917-4288-8be0-5081e8803c05 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.222107 Jun 24 08:20:52.827096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 174/340] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:52 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:52.922190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:52.922975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:52.929765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.930213 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.930984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:52.931610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:52.935743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:53.113827 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:53.115017 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:53.118056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.128707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3dd97a2d-f10f-4f2f-9a71-bba053bb0f3d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.210694 Jun 24 08:20:53.131436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 167/341] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:52 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:53.145356 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.146453 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.147426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.148547 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.211592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:53.212821 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:53.227534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.228060 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.231153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.231720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.346579 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.355041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-263be86f-8c52-4ac6-93ac-d36a8f060d24 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1270 microversion: 2.1 time: 0.148992 Jun 24 08:20:53.355641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 168/342] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:53 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:53.379331 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:53.380372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:53.387013 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.387488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.388541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.388975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.419306 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.429156 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.430660 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.433442 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c1687e9c-72fd-440f-bf76-60869040defe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.327820 Jun 24 08:20:53.434835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 175/343] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:53 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:53.439978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4ca4b863-fcfe-4241-bb50-feb4b7942944 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:53.440657 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4ca4b863-fcfe-4241-bb50-feb4b7942944 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:53.481829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.509448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4ca4b863-fcfe-4241-bb50-feb4b7942944 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:53.511235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2aa1f7b2-63a5-4911-9ab1-f99adfad6860 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1303 microversion: 2.1 time: 0.128800 Jun 24 08:20:53.512018 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 169/344] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:53 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:53.526821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4ca4b863-fcfe-4241-bb50-feb4b7942944 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1095 microversion: 2.1 time: 0.090845 Jun 24 08:20:53.529145 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 176/345] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:53 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:53.844374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:53.845515 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:53.852789 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.853438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:53.854444 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:53.854982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.021852 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.031991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c50c2301-71ab-475e-a94b-c6bfcd89fd41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.192311 Jun 24 08:20:54.032923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 170/346] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:53 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:54.147100 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:54.148052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:54.154938 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.155620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.156622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.157209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.304574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.316495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-15acf81a-fb00-4108-8fd2-cfc35bc11892 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.173182 Jun 24 08:20:54.317364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 177/347] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:54 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:54.372315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:54.373308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:54.382555 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.383255 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.384389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.384831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.452229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:54.453421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:54.453923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.462192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4c3020b4-1753-4f01-98dc-d34bd9fde4d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1270 microversion: 2.1 time: 0.093604 Jun 24 08:20:54.464453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 171/348] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:54 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:54.471518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.472653 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.473993 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.474734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.534160 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:54.535259 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:54.543168 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.543771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.545047 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.545759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.864619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.864619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.866245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.866245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ec5b3212-041a-414a-8a45-ca7f0ee94e20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.343567 Jun 24 08:20:54.866245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 178/349] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:54 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:54.866245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:54.867812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:54.867812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.867812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.867812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:54.868312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:54.868485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.868485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0b14d2e7-5036-4454-bc57-e65e660e3c24 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.321276 Jun 24 08:20:54.868485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 172/350] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:54 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:54.905191 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:54.909704 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:54.914393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-95211c2f-6636-483f-8f19-d6bb7176a945 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1145 microversion: 2.1 time: 0.120098 Jun 24 08:20:54.925861 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 179/351] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:54 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1145 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:55.050771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:55.051477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:55.057557 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.057993 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.058750 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.059173 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.287439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:55.304417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-babff37b-43b9-4ea6-a42e-85f10d5dd4bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.258960 Jun 24 08:20:55.315086 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 173/352] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:55 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:55.336005 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:55.337176 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:55.347719 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.347841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.348842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.349499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.502626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:55.503470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:55.513422 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.514093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.517940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.520746 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.638105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:55.671195 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-539fcf86-62ac-46ee-9f69-cbc7e4eb93df tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1278 microversion: 2.1 time: 0.167439 Jun 24 08:20:55.671195 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 174/353] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:55 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:20:55.674702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:55.696313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-31c81ecd-ab02-4826-aac9-ca580a1a8379 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.365343 Jun 24 08:20:55.702052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 180/354] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:55 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:55.921657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:55.922956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:55.930137 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-a6209589-464a-4024-a62d-f29518ef8b19 req-11a065a2-d833-47a6-ac7a-b52b0504721b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a24c2d2-6c59-4080-8eb6-4f0431fd54d4", "tag": "3ff5827b-387d-47d9-aadc-66a7f6553c95"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:55.936653 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.946092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.946092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.946092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:55.971494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-a6209589-464a-4024-a62d-f29518ef8b19 req-11a065a2-d833-47a6-ac7a-b52b0504721b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:55.973055 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-a6209589-464a-4024-a62d-f29518ef8b19 req-11a065a2-d833-47a6-ac7a-b52b0504721b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.012026 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-a6209589-464a-4024-a62d-f29518ef8b19 req-11a065a2-d833-47a6-ac7a-b52b0504721b service nova] Creating event network-changed:3ff5827b-387d-47d9-aadc-66a7f6553c95 for instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 on hv-cinder-83482 Jun 24 08:20:56.023641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-a6209589-464a-4024-a62d-f29518ef8b19 req-11a065a2-d833-47a6-ac7a-b52b0504721b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103672 Jun 24 08:20:56.025158 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 181/355] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:56.038595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:56.039777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:56.060872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.061970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.065278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.070934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.288355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.307182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.311163 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.311163 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-01845ae5-e014-468a-a6bb-5d6b389b6819 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.399542 Jun 24 08:20:56.312614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 175/356] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:55 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:56.329947 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:56.330995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:56.347380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.348161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.349158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.349770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.370569 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.379817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6eb8d922-99dc-42d8-8197-1949c80f7afe tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.351997 Jun 24 08:20:56.392795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 182/357] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:56 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:56.397671 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:56.398460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:56.406665 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.408162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.409285 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.410249 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.439442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.450522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c33e1186-7b43-402a-9018-3e08af21ea66 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1193 microversion: 2.1 time: 0.135314 Jun 24 08:20:56.451547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 176/358] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:56 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:56.642567 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.651348 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bc6c1dba-d932-452c-8ab1-9687603c954a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.257339 Jun 24 08:20:56.652693 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 183/359] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:56 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:56.684547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:56.685478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:56.693615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.693967 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.694949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.695538 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.721660 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:56.722509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:56.728553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.729085 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.729921 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:56.730466 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:56.765759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.774990 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-836fabea-5905-42d4-ac9c-da91c5a92a01 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1276 microversion: 2.1 time: 0.095062 Jun 24 08:20:56.775669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 177/360] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:56 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:56.897385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:56.898485 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7f10973a-3844-4514-a3b4-30397dde81ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.180677 Jun 24 08:20:56.899275 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 184/361] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:56 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:57.338166 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:57.341593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:57.353729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.356283 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.357066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.363445 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.402714 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:57.402714 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:57.416421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.416871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.417637 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.418068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.769320 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:57.774234 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:57.780672 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-903cb0d9-01e5-49df-98f4-660dbc1c081c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.385535 Jun 24 08:20:57.781819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 185/362] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:57 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:57.788300 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:57.789218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:57.799084 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:57.801347 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.802045 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.803165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.804379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.807205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:57.811958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7f30d2df-4846-4264-8ae2-1fdcff53038e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.481298 Jun 24 08:20:57.826924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 178/363] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:57 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:20:57.833513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:57.834409 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:57.848345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.850457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.855095 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.855742 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.934069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:57.947742 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-da977709-f5f6-44c7-b4f0-ee2a8d546716 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1211 microversion: 2.1 time: 0.163182 Jun 24 08:20:57.950339 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 186/364] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:57 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1211 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:57.958909 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:57.961188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:57.968232 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.968971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:57.970888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:57.971673 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.264316 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:58.296812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b954e0a9-d0d0-4c6b-bcbc-3a187a85319b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.457136 Jun 24 08:20:58.299338 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 179/365] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:57 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:58.307476 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:58.313373 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:58.327668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:58.338254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.343405 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:58.344431 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.376303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:58.431691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bf7eca69-95f8-44ac-b20d-00b929806a91 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.476490 Jun 24 08:20:58.435424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 187/366] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:57 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:58.646346 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:58.656235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bd2bc7a7-c6f5-4b01-9bcb-029d9f06d786 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.354979 Jun 24 08:20:58.658801 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 180/367] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:58 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:58.802218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:58.802218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:58.811958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:58.812440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.815644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:58.816025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.836334 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:58.846132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:58.856002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:58.856466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.857232 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:58.857656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:58.930151 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=4 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:59.113147 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.114406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.123903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ef17921c-ebe1-483a-9353-4c46f08e3157 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.330720 Jun 24 08:20:59.124562 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 188/368] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:58 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:59.131685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.133456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.135015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f5f404f2-221c-46bc-9345-b026778555e6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.306316 Jun 24 08:20:59.136172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 181/369] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:20:58 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:20:59.142568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:59.150995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:59.150995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.150995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.151695 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.152256 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.306063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-4c5abf68-13b8-47ad-b55f-a80a0cca7494 req-c71f459e-4ae7-4445-ab3c-14794c514fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860c6adc-4385-4cae-8bf0-5d9c1cbb29a3", "tag": "2b655029-389e-40c2-9cd7-9df1b683c516"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:59.324240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-4c5abf68-13b8-47ad-b55f-a80a0cca7494 req-c71f459e-4ae7-4445-ab3c-14794c514fd2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.324639 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-4c5abf68-13b8-47ad-b55f-a80a0cca7494 req-c71f459e-4ae7-4445-ab3c-14794c514fd2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.349026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-4c5abf68-13b8-47ad-b55f-a80a0cca7494 req-c71f459e-4ae7-4445-ab3c-14794c514fd2 service nova] Creating event network-changed:2b655029-389e-40c2-9cd7-9df1b683c516 for instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 on hv-cinder-83482 Jun 24 08:20:59.370002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-4c5abf68-13b8-47ad-b55f-a80a0cca7494 req-c71f459e-4ae7-4445-ab3c-14794c514fd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067522 Jun 24 08:20:59.370870 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 182/370] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:59.374990 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.378348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:59.379940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:59.387620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-71e4911d-e208-47f7-bb61-5a32146a11c6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1279 microversion: 2.1 time: 0.262012 Jun 24 08:20:59.388572 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 189/371] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:59 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:59.391830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.392572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.393501 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.394091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.454659 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:59.455892 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:59.472334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.477369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.477369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.477369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.559104 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.590167 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-208c05b9-1871-4333-b3de-e5a9385540ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.202715 Jun 24 08:20:59.601464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 183/372] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:59 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:59.612126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-173cd00e-71bf-4dea-9baf-c4473d1fc9b0 req-514936ad-d61e-45d7-b5a1-76236a6137ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25911a0-62f3-4ceb-8e93-5a492c985fae", "name": "network-vif-plugged", "status": "completed", "tag": "88e3b09c-5211-435b-a4f7-a0439b4d71c3"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:20:59.626051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-173cd00e-71bf-4dea-9baf-c4473d1fc9b0 req-514936ad-d61e-45d7-b5a1-76236a6137ac service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.626647 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-173cd00e-71bf-4dea-9baf-c4473d1fc9b0 req-514936ad-d61e-45d7-b5a1-76236a6137ac service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.649683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-173cd00e-71bf-4dea-9baf-c4473d1fc9b0 req-514936ad-d61e-45d7-b5a1-76236a6137ac service nova] Creating event network-vif-plugged:88e3b09c-5211-435b-a4f7-a0439b4d71c3 for instance c25911a0-62f3-4ceb-8e93-5a492c985fae on hv-cinder-83482 Jun 24 08:20:59.666737 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-173cd00e-71bf-4dea-9baf-c4473d1fc9b0 req-514936ad-d61e-45d7-b5a1-76236a6137ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069098 Jun 24 08:20:59.667361 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 184/373] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:20:59.683379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:20:59.684479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:20:59.696499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.696944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.697716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:20:59.698144 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:20:59.716659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:59.803585 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.818046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2fe5a44d-6162-4b94-a73d-93c8f72f25ce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.367551 Jun 24 08:20:59.828821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 190/374] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:59 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:20:59.971267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:20:59.980353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-48742365-44b5-48d3-9470-b19419efa77c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.305243 Jun 24 08:20:59.981110 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 185/375] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:20:59 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:00.141901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:00.142644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:00.154925 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:00.155862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:00.162578 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.166613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.169859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.169859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.170175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.170651 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.173073 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.177114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.445162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:00.453172 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7e23e544-d732-4082-b459-05433bd38c1a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.315790 Jun 24 08:21:00.457601 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 191/376] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:00 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:00.462368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:00.463145 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:00.478462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:00.483299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.483719 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.490058 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:00.490815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.491413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.495566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:00.499420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-76beb39f-6ca8-4984-be3c-d114c411c5fd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.349380 Jun 24 08:21:00.509415 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 186/377] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:00 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:00.611392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:00.612334 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:00.622757 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.623474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.624416 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.624992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.753201 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:00.762594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-14fea60f-c9b8-4ece-b313-021832aff57f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.303702 Jun 24 08:21:00.764272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 192/378] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:00 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:00.838194 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:00.838879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:00.854346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.854793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.856530 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:00.856966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:00.879824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:00.891112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6ab7c4a9-a829-4166-b04f-3db8c9a15e6d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.285802 Jun 24 08:21:00.895417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 187/379] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:00 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:00.999919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:01.000749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:01.013258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.023749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.025061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.025744 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.042770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.053484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-65f0a9be-8400-459f-9ede-8753f4b2440f tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.221953 Jun 24 08:21:01.057239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 193/380] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:00 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:01.210657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.220115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-69163e3f-4845-4786-acea-2fa69fb3e06a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.223997 Jun 24 08:21:01.221154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 188/381] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:00 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:01.396430 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-678a5dd2-05b8-4bc8-b811-e1109aed8d60 req-74f169d0-9197-426b-bd8a-5675d762d180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401989f0-8369-4e86-92c8-76b65a93f9cb", "tag": "28a38618-88aa-4717-b585-2dc906547505"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:01.408840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-678a5dd2-05b8-4bc8-b811-e1109aed8d60 req-74f169d0-9197-426b-bd8a-5675d762d180 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.409809 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-678a5dd2-05b8-4bc8-b811-e1109aed8d60 req-74f169d0-9197-426b-bd8a-5675d762d180 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.424036 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-678a5dd2-05b8-4bc8-b811-e1109aed8d60 req-74f169d0-9197-426b-bd8a-5675d762d180 service nova] Creating event network-changed:28a38618-88aa-4717-b585-2dc906547505 for instance 401989f0-8369-4e86-92c8-76b65a93f9cb on hv-cinder-83482 Jun 24 08:21:01.440049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-678a5dd2-05b8-4bc8-b811-e1109aed8d60 req-74f169d0-9197-426b-bd8a-5675d762d180 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047836 Jun 24 08:21:01.441557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 194/382] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:01.471894 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:01.472434 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:01.474420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:01.480385 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.483211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.486306 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.487119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.541883 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:01.543816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:01.571717 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.581772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.582773 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.585894 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.754103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.766352 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bc64685e-df5a-4a06-9e38-9120303ba22e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.298422 Jun 24 08:21:01.779157 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 189/383] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:01 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:01.780605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:01.781393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:01.795953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.796458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.797299 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.797736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.818065 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.826554 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.828164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.830211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d44498cc-d9e9-4f79-bf4f-57c1110127ca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.303562 Jun 24 08:21:01.830873 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 195/384] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:01 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:01.916232 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:01.916979 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:01.923214 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.923753 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.924631 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:01.925125 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:01.949142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:01.957829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d76962cd-e07c-4786-ad0f-4ecd696be646 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.181066 Jun 24 08:21:01.958742 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 190/385] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:01 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:02.058699 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:02.066927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0d6b6e12-f4fd-4512-bb88-0df28c914a68 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1367 microversion: 2.1 time: 0.154621 Jun 24 08:21:02.067640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 196/386] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:01 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:02.071060 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:02.071660 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:02.078238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.079366 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.080209 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.080649 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.215001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:02.222506 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6e22d82b-3364-4da0-9db4-3c0879b87bfd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.155268 Jun 24 08:21:02.223075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 191/387] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:02 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:02.237218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:02.237834 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:02.245406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.245667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.246422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.246860 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.450930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:02.455795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:02.460826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0968f675-2b72-4586-bc8c-34eaf9ad5cd8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.227530 Jun 24 08:21:02.461400 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 197/388] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:02 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:02.787657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:02.788345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:02.794249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=22 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:02.796006 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.796594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.798787 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.799322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.855153 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:02.856186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:02.871937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.872734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:02.873668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:02.874261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.009690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.020916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7c4723f5-fcd3-4e6c-9fa0-240dc17dbf57 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.237491 Jun 24 08:21:03.030255 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 192/389] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:02 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:03.036368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:03.037098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:03.044088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.044610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.045470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.046617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.138127 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.149786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.151548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.152990 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2532260f-3834-4091-a533-1515dc5f15ac tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.302114 Jun 24 08:21:03.153907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 198/390] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:02 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:03.175815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:03.176606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:03.184674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.185720 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.187829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.187829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.218617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.231431 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b94cf682-d292-454f-ac31-5de6720e83a4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.199910 Jun 24 08:21:03.233149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 193/391] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:03 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:03.249263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:03.253086 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:03.260642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.261689 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.262774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.263701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.410337 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.419536 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4915a1e8-7dd0-4ca7-b7f2-ad352482a27a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1556 microversion: 2.1 time: 0.255172 Jun 24 08:21:03.422164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 199/392] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:03 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:03.428879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-bbde1290-6be4-48a9-944b-5001f2b9fd55 req-baf21522-b032-4b45-9207-662025808333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a24c2d2-6c59-4080-8eb6-4f0431fd54d4", "name": "network-vif-plugged", "status": "completed", "tag": "3ff5827b-387d-47d9-aadc-66a7f6553c95"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:03.441131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-bbde1290-6be4-48a9-944b-5001f2b9fd55 req-baf21522-b032-4b45-9207-662025808333 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.441729 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-bbde1290-6be4-48a9-944b-5001f2b9fd55 req-baf21522-b032-4b45-9207-662025808333 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.457426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-bbde1290-6be4-48a9-944b-5001f2b9fd55 req-baf21522-b032-4b45-9207-662025808333 service nova] Creating event network-vif-plugged:3ff5827b-387d-47d9-aadc-66a7f6553c95 for instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 on hv-cinder-83482 Jun 24 08:21:03.463703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-bbde1290-6be4-48a9-944b-5001f2b9fd55 req-baf21522-b032-4b45-9207-662025808333 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041213 Jun 24 08:21:03.465699 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 200/393] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:03.470486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:03.471171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:03.479564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.480163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.481051 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.481578 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.509380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.521043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-84038bd3-1eaf-4783-bebf-dfa342064a23 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.275985 Jun 24 08:21:03.522825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 194/394] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:03 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:03.524350 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=20 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:03.528915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:03.529727 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:03.538586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.539330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.552577 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:03.553252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:03.600417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b9cda1aa-c6ed-4973-82be-9df60d3575f8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129470 Jun 24 08:21:03.600417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 201/395] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:21:03 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:03.710026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:03.720698 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-045ede4e-f985-4a30-9048-b96b3a3570c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.195334 Jun 24 08:21:03.721595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 195/396] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:03 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:04.037660 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:04.038708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:04.045001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:04.046730 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.047600 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.048747 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.049398 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.172824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:04.174560 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:04.182832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.184955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.189484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.190178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.222956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:04.241084 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f6049376-e1de-466d-862c-057184da657b tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.206953 Jun 24 08:21:04.250760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 202/397] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:04 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:04.256074 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:04.257277 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:04.263982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.264598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.265556 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.266682 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.720948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:04.721781 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:04.730214 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:04.731934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:04.733458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d890d134-d3ad-411d-b95c-ae8496de1472 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.564608 Jun 24 08:21:04.734514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 196/398] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:04 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:04.739711 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:04.740515 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:04.744687 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-265b75a3-69c9-4a43-8d62-f2b52cb8ba61 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.492518 Jun 24 08:21:04.752455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 203/399] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:04 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:04.763208 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.763953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.773857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.773857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.774103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:04.774103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:04.774103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.775030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:04.775959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:04.776928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.054318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:05.065634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-09830ab9-57d5-46bb-8059-b5f8416cf44b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.311800 Jun 24 08:21:05.070387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 204/400] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:04 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:05.087774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:05.099274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-78a261a2-dd7b-4e04-8b7b-16ebb7dcecaf tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.363017 Jun 24 08:21:05.100132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 197/401] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:04 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:05.258260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:05.259785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:05.267549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.268448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.269638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.270300 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.452657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-c25cef87-52e9-4244-b40d-26ec942cabb6 req-8af7cfae-1ffb-45c9-a6ee-94e3841bc0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25911a0-62f3-4ceb-8e93-5a492c985fae", "tag": "88e3b09c-5211-435b-a4f7-a0439b4d71c3"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:05.457022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:05.466349 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b7e7146e-a0c4-4e29-be0a-dc9cec6c70ee tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.212054 Jun 24 08:21:05.471734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 205/402] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:05 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:05.477480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-c25cef87-52e9-4244-b40d-26ec942cabb6 req-8af7cfae-1ffb-45c9-a6ee-94e3841bc0cc service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.478193 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-c25cef87-52e9-4244-b40d-26ec942cabb6 req-8af7cfae-1ffb-45c9-a6ee-94e3841bc0cc service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.501278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-c25cef87-52e9-4244-b40d-26ec942cabb6 req-8af7cfae-1ffb-45c9-a6ee-94e3841bc0cc service nova] Creating event network-changed:88e3b09c-5211-435b-a4f7-a0439b4d71c3 for instance c25911a0-62f3-4ceb-8e93-5a492c985fae on hv-cinder-83482 Jun 24 08:21:05.508121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-c25cef87-52e9-4244-b40d-26ec942cabb6 req-8af7cfae-1ffb-45c9-a6ee-94e3841bc0cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059440 Jun 24 08:21:05.508968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 198/403] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:05.753283 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:05.754093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:05.769041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.769041 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.769341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:05.769691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:05.774168 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.776943 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.785198 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.785778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:05.786675 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:05.787200 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.009262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.013987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.022459 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.024023 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.024432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2f2ce9ce-d3cb-48d3-97a3-55c4c8b43255 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.261054 Jun 24 08:21:06.025111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 199/404] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:05 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:06.025578 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7ee2a6d7-ddf7-43f1-9839-d0713c406eca tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.276606 Jun 24 08:21:06.026128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 206/405] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:05 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:06.087439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:06.088146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:06.094179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:06.094676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.095447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:06.095877 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.116642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:06.117243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:06.123384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:06.123838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.124667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:06.125690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.299887 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.307421 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fe07d83a-fb71-4204-8656-c836eb07a785 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.224125 Jun 24 08:21:06.308229 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 200/406] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:06 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:06.322207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.329971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1267807b-1cbb-4c78-8c47-01b454a782f4 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.217782 Jun 24 08:21:06.330793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 207/407] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:06 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:06.487478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:06.488065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:06.494312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:06.494751 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.495505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:06.495932 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:06.674838 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:06.687089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-45b53322-df1e-4778-90cf-39f0ca4c42bb tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1370 microversion: 2.1 time: 0.203373 Jun 24 08:21:06.688503 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 201/408] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:06 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:07.042838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:07.043585 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:07.050548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.051128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.052502 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.052995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.053927 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:07.055030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:07.072487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.072487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.073260 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.073738 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.139950 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:07.285177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.296584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d3e896f9-d8e4-425a-893d-2bbf2f52a0ae tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.259257 Jun 24 08:21:07.298351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 208/409] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:07 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:07.315039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.323492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.324460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:07.325061 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:07.325196 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.326216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7416ed51-c4f9-4230-9db4-641c93d02cb8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.285941 Jun 24 08:21:07.326763 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 202/410] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:07 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:07.331820 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.332299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.333048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.333474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.346078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:07.346776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:07.353249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.353776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.354681 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.355179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.544285 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.555971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9ebf6922-1f1e-417c-89ec-e94882bab218 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.235146 Jun 24 08:21:07.556867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 209/411] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:07 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:07.562298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.577929 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-886a5c3e-96b6-4aaf-a42f-6fa81590c95a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.235756 Jun 24 08:21:07.580736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 203/412] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:07 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:07.706143 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:07.707463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:07.715112 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.715562 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.716363 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.716798 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.731283 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-e4f5f5e1-a089-437d-bd71-3227940a67e3 req-a3119718-6b66-4090-892c-d94bcab5d70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860c6adc-4385-4cae-8bf0-5d9c1cbb29a3", "name": "network-vif-plugged", "status": "completed", "tag": "2b655029-389e-40c2-9cd7-9df1b683c516"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:07.744837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-e4f5f5e1-a089-437d-bd71-3227940a67e3 req-a3119718-6b66-4090-892c-d94bcab5d70d service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.755178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-e4f5f5e1-a089-437d-bd71-3227940a67e3 req-a3119718-6b66-4090-892c-d94bcab5d70d service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.758290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-e4f5f5e1-a089-437d-bd71-3227940a67e3 req-a3119718-6b66-4090-892c-d94bcab5d70d service nova] Creating event network-vif-plugged:2b655029-389e-40c2-9cd7-9df1b683c516 for instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 on hv-cinder-83482 Jun 24 08:21:07.766110 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-e4f5f5e1-a089-437d-bd71-3227940a67e3 req-a3119718-6b66-4090-892c-d94bcab5d70d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 Jun 24 08:21:07.766724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 204/413] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:07.863700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:07.873701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8cb322b9-6249-4eaa-92b4-05677022422c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1564 microversion: 2.1 time: 0.172262 Jun 24 08:21:07.887704 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 210/414] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:07 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:07.896086 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:07.896736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:07.903787 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.904308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.905254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:07.905756 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:07.999741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2a2de2ab-06e7-4c0d-acfe-68f778aeb746 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109183 Jun 24 08:21:08.000526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 205/415] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:21:07 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:08.317319 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:08.317982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:08.324868 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.325484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.326049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.326475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.344668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:08.345599 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:08.351871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.352434 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.353298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.353894 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.524228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:08.532770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6b92736d-075c-42e1-96d5-2f723037af8c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.219824 Jun 24 08:21:08.538891 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 211/416] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:08 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:08.558227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:08.577402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:08.579569 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:08.580340 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:08.582960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:08.585471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ae1909ca-055d-45b0-baad-46d3baddc222 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1740 microversion: 2.20 time: 0.245066 Jun 24 08:21:08.586246 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 206/417] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:08 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:08.592557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.593405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.594942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.595548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.596280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:08.597094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:08.607421 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.607867 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.608661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:08.609143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:08.814364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:08.818588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:08.823819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d37685eb-9086-4790-b359-560d1e3dfeb9 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.251342 Jun 24 08:21:08.824635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 212/418] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:08 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:08.827600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5dbb02c5-5f4a-433a-8a7f-ad04004f6c8e tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.235986 Jun 24 08:21:08.828342 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 207/419] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:08 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:09.288165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-84f75df7-81f4-4efa-b922-96a92e08bdba req-31c621fe-fbef-4d0a-a10b-b7e5a889967a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a24c2d2-6c59-4080-8eb6-4f0431fd54d4", "tag": "3ff5827b-387d-47d9-aadc-66a7f6553c95"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:09.296394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-84f75df7-81f4-4efa-b922-96a92e08bdba req-31c621fe-fbef-4d0a-a10b-b7e5a889967a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.296918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-84f75df7-81f4-4efa-b922-96a92e08bdba req-31c621fe-fbef-4d0a-a10b-b7e5a889967a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.307888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-84f75df7-81f4-4efa-b922-96a92e08bdba req-31c621fe-fbef-4d0a-a10b-b7e5a889967a service nova] Creating event network-changed:3ff5827b-387d-47d9-aadc-66a7f6553c95 for instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 on hv-cinder-83482 Jun 24 08:21:09.312934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-84f75df7-81f4-4efa-b922-96a92e08bdba req-31c621fe-fbef-4d0a-a10b-b7e5a889967a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028486 Jun 24 08:21:09.313740 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 213/420] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:09.549726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:09.550322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:09.556327 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.556768 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.557518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.557949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.614616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:09.615785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:09.623836 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.624361 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.626006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.626508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.757639 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:09.765194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8e2a70f5-f937-42a6-a7ea-3630d25c6663 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.219400 Jun 24 08:21:09.775280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 208/421] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:09 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:09.820330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:09.830748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:09.832769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:09.834058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f13d8dd5-f454-4c5b-bcef-c892313e936d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1722 microversion: 2.20 time: 0.224935 Jun 24 08:21:09.834716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 214/422] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:09 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:09.847348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:09.847348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:09.852777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:09.853909 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:09.856554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.857224 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.858495 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.859439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.862222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.862769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:09.863618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:09.864359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:10.081606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:10.086410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:10.090855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c24518c0-cc40-42c3-a6a7-98af6140e1de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.241941 Jun 24 08:21:10.091433 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 215/423] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:09 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:10.105215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2f9be2a4-4fb6-4ef1-95b7-d61dab72b576 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1318 microversion: 2.1 time: 0.264416 Jun 24 08:21:10.105810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 209/424] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:09 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:10.782899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:10.783493 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:10.789911 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:10.790350 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:10.791092 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:10.791517 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:10.795503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:10.854741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:10.855312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:10.861635 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:10.862172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:10.863068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:10.863567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:10.977412 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:10.985668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2fb4e01f-8539-428d-8910-c630c0326f72 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.207075 Jun 24 08:21:10.986245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 216/425] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:10 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:11.021990 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:11.030264 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:11.032480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:11.046518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d39f5777-ca81-449a-838f-56acf06ff03b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1722 microversion: 2.20 time: 0.182888 Jun 24 08:21:11.046518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 210/426] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:10 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:11.108309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:11.108849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:11.115073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:11.115525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:11.116308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:11.116739 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:11.122974 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:11.123664 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:11.130766 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:11.131301 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:11.132135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:11.132830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:11.321158 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:11.327415 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:11.334926 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a7e5d209-8a55-4623-ac1d-fd60abdf0431 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.230471 Jun 24 08:21:11.336016 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 217/427] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:11 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:11.347505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-47cb15ac-feeb-4d66-8523-b21aecdf86d6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1507 microversion: 2.1 time: 0.228512 Jun 24 08:21:11.348075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 211/428] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:11 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:12.002913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:12.003437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:12.009801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:12.010250 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:12.010998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:12.011425 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:12.059709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:12.060274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:12.066940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:12.067396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:12.068146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:12.068663 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:12.188818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:12.196565 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0a019e77-f765-41c9-9688-2100e476ac60 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.197953 Jun 24 08:21:12.206676 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 218/429] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:11 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:12.235369 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:12.243233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:12.244736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:12.245861 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-96cb525f-d4b3-4f63-b514-385e946925a3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1722 microversion: 2.20 time: 0.191505 Jun 24 08:21:12.246402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 212/430] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:12 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:12.352610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:12.353212 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:12.359140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:12.360439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:12.361227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:12.361661 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:12.490748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:12.499020 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-38a3c160-9189-445e-ae4e-7dff18eccd83 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.150237 Jun 24 08:21:12.499573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 219/431] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:12 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:13.213242 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:13.213847 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:13.215822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:13.221249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.221694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.222452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.222887 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.264902 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:13.267086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:13.274448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.274999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.275838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.276409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.413641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:13.420936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0420611d-089e-46e4-8fa1-3f451e9cfc1b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.211494 Jun 24 08:21:13.421499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 213/432] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:13 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:13.448260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:13.457939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:13.458314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:13.459454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8c384ccd-d184-4a5a-98b3-19d529f23d73 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1722 microversion: 2.20 time: 0.198513 Jun 24 08:21:13.460011 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 220/433] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:13 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:13.517765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:13.518362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:13.524295 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.524728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.525475 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.525898 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.668074 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:13.671222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-d2368b2a-3f15-44b4-a11c-bec0ec78b3cd req-c0ecc165-fe1b-41a1-b6a7-62bb504a22a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "name": "network-vif-unplugged", "status": "completed", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:13.678754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-70daa714-0244-43c1-9949-64f40ed25612 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.164801 Jun 24 08:21:13.679587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 214/434] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:13 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:13.687811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-d2368b2a-3f15-44b4-a11c-bec0ec78b3cd req-c0ecc165-fe1b-41a1-b6a7-62bb504a22a7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:13.691946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-d2368b2a-3f15-44b4-a11c-bec0ec78b3cd req-c0ecc165-fe1b-41a1-b6a7-62bb504a22a7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:13.699513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-d2368b2a-3f15-44b4-a11c-bec0ec78b3cd req-c0ecc165-fe1b-41a1-b6a7-62bb504a22a7 service nova] Creating event network-vif-unplugged:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:21:13.704473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-d2368b2a-3f15-44b4-a11c-bec0ec78b3cd req-c0ecc165-fe1b-41a1-b6a7-62bb504a22a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037925 Jun 24 08:21:13.705039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 221/435] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:21:14.438220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:14.438743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:14.444774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:14.445217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:14.445965 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:14.446392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:14.479839 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:14.480653 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:14.487643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:14.488092 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:14.488941 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:14.489372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:14.637355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:14.645958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-73826a00-92f9-4612-8854-df59caaf2f9b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.212029 Jun 24 08:21:14.646568 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 215/436] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:14 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:14.665848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:14.751163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:14.751163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:14.751163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4106f141-47a2-472a-80bf-4f041f3f1b07 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1722 microversion: 2.20 time: 0.202538 Jun 24 08:21:14.751529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 222/437] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:14 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:14.751620 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:14.751620 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:14.751620 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:14.751620 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:14.751970 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:14.751970 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:14.837020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:14.845319 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c239bf42-480f-4858-8fcf-a9e87ceb7053 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.151720 Jun 24 08:21:14.847635 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 216/438] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:14 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:15.663932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:15.664570 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:15.670701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.671144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.671895 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.672619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.767910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:15.768615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:15.775043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.775544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.776380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.776851 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.814606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:15.823588 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c1a37993-44cb-4fbc-b6b2-33c355844541 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.163345 Jun 24 08:21:15.833950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 223/439] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:15 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:15.863670 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:15.864403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:15.870551 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.870999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.871806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.872257 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.916487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:15.926605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:15.928252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:15.929414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ba5d9501-3234-4aeb-a6e7-8036ba86cb0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1725 microversion: 2.20 time: 0.166539 Jun 24 08:21:15.929960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 217/440] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:15 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:15.949354 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea0effb3-64c4-4864-93c4-8f5ccd37e3ec"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:15.950684 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:15.956978 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.957424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:15.958179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:15.958607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:16.029075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:16.037721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a33784fc-8c37-4d8d-b527-07fe809211b3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1721 microversion: 2.1 time: 0.178866 Jun 24 08:21:16.038263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 224/441] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:15 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:16.841903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:16.842573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:16.849471 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:16.849917 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:16.850674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:16.851092 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:16.959764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:16.993632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:17.001907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0aeec4ed-1023-44d2-bc11-303454e9229a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.163986 Jun 24 08:21:17.009023 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 225/442] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:16 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:17.055130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:17.055764 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:17.062349 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.063354 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:17.064457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.065150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:17.210013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:17.219191 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-973d41c1-e640-498a-8112-af5610142e19 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1698 microversion: 2.1 time: 0.167597 Jun 24 08:21:17.219749 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 226/443] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:17 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:17.239626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-206ecaea-8404-4023-8c3f-c606be31fe0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:17.247333 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-206ecaea-8404-4023-8c3f-c606be31fe0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.247780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-206ecaea-8404-4023-8c3f-c606be31fe0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:17.271070 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-206ecaea-8404-4023-8c3f-c606be31fe0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Going to try to start instance {{(pid=118296) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 08:21:17.507865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-206ecaea-8404-4023-8c3f-c606be31fe0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action" status: 202 len: 0 microversion: 2.1 time: 0.271876 Jun 24 08:21:17.508507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 227/444] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:21:17 2022] POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:21:17.517436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:17.518120 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:17.524528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.524985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:17.525746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.526174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:17.558220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-26c9f108-f6b5-4b6e-a869-9bf994ce2145 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.612644 Jun 24 08:21:17.559786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 218/445] 10.222.0.42 () {62 vars in 1363 bytes} [Fri Jun 24 08:21:15 2022] POST /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 188 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:21:17.686568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:17.697563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-724e97e4-7886-4f7e-8c68-29b1666d53a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1707 microversion: 2.1 time: 0.184244 Jun 24 08:21:17.698067 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 228/446] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:17 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1707 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:17.783220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:17.784189 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:17.791272 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.792004 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:17.792828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:17.794087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.019750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:18.020386 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:18.026896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:18.027363 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.028146 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:18.028608 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.064055 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9b0a20cf-c06b-4883-871a-2eee93b0c556 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/action" status: 202 len: 0 microversion: 2.20 time: 0.286244 Jun 24 08:21:18.068476 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 219/447] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 24 08:21:17 2022] POST /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:21:18.073425 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:18.074241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:18.081586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:18.082030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.082980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:18.083413 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.241930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:18.250644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6e31ad0c-b41f-4fcd-8b5c-62e1ddfa256e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.234826 Jun 24 08:21:18.251880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 229/448] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:18 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:18.282349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:18.295441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:18.297608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:18.299108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d5dfdd39-d2d6-4ce8-a561-f77adfc4c277 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1751 microversion: 2.20 time: 0.229479 Jun 24 08:21:18.299656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 220/449] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:18 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:18.716101 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:18.716766 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:18.723798 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:18.724276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.725027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:18.725457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:18.865234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:18.873408 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8373d735-be88-4cd2-a1a7-af4e6ad87098 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1707 microversion: 2.1 time: 0.161198 Jun 24 08:21:18.874001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 230/450] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:18 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:19.268873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:19.270494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:19.279598 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.280475 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.282997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.283611 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.318183 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:19.318778 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:19.324866 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.325309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.326052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.326477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.503368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:19.516581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-577e3ce1-7cbe-4e45-b99c-2f21590bd666 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.250319 Jun 24 08:21:19.526376 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 221/451] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:19 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:19.531299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:19.539949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:19.541598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:19.542744 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-36d4c457-1ab8-41ec-bad5-f5aadc5e6eb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1751 microversion: 2.20 time: 0.228455 Jun 24 08:21:19.543293 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 231/452] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:19 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:19.891764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:19.892393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:19.898577 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.902516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.902516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.902516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.975173 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-f0ef3117-26fc-4c17-b97f-194aa2ac75f6 req-8b9c1ae1-b657-49d3-80f7-c44ad61dc5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401989f0-8369-4e86-92c8-76b65a93f9cb", "name": "network-vif-plugged", "status": "completed", "tag": "28a38618-88aa-4717-b585-2dc906547505"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:19.983969 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-f0ef3117-26fc-4c17-b97f-194aa2ac75f6 req-8b9c1ae1-b657-49d3-80f7-c44ad61dc5f2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:19.991266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-f0ef3117-26fc-4c17-b97f-194aa2ac75f6 req-8b9c1ae1-b657-49d3-80f7-c44ad61dc5f2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:19.996983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-f0ef3117-26fc-4c17-b97f-194aa2ac75f6 req-8b9c1ae1-b657-49d3-80f7-c44ad61dc5f2 service nova] Creating event network-vif-plugged:28a38618-88aa-4717-b585-2dc906547505 for instance 401989f0-8369-4e86-92c8-76b65a93f9cb on hv-cinder-83482 Jun 24 08:21:20.002522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-f0ef3117-26fc-4c17-b97f-194aa2ac75f6 req-8b9c1ae1-b657-49d3-80f7-c44ad61dc5f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 Jun 24 08:21:20.003113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 232/453] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:21:20.053240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:20.061704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2fc24c65-edd3-43cf-a6d0-9ee78843e6e8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1707 microversion: 2.1 time: 0.174507 Jun 24 08:21:20.062355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 222/454] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:19 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:20.534849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:20.535573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:20.542080 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:20.542575 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:20.543335 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:20.543765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:20.548644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:20.561462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:20.562995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:20.581202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:20.581678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:20.582452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:20.582884 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:20.745054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:20.745054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-201b4a5f-619a-4518-8877-468dac40bf7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.211218 Jun 24 08:21:20.745054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 233/455] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:20 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:20.761669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:20.770260 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:20.771755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:20.772965 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ccc631b8-15c1-4752-bd11-ba7f0fed1762 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1753 microversion: 2.20 time: 0.215730 Jun 24 08:21:20.773512 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 223/456] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:20 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:21.078907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:21.079510 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:21.086204 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:21.086638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:21.087403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:21.087831 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:21.232244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:21.236721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7b3b9365-6483-4a44-8b7b-901f5f9a90a2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1711 microversion: 2.1 time: 0.161640 Jun 24 08:21:21.237296 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 234/457] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:21 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:21.758754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:21.759373 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:21.766569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:21.767013 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:21.767783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:21.768230 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:21.791020 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:21.791679 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:21.798763 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:21.799210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:21.799961 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:21.800438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:21.957237 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:21.964708 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6c3f8b31-7794-4f4f-b6bd-00c1296a76c0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.209789 Jun 24 08:21:21.965268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 224/458] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:21 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:21.981498 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:21.992795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:21.994314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:21.995488 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c71b9b65-8620-4fe3-b3db-8459b51f82cd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1753 microversion: 2.20 time: 0.208465 Jun 24 08:21:21.996038 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 235/459] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:21 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:22.981842 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:22.982595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:22.989119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:22.989567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:22.990385 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:22.990812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:23.014549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:23.015753 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:23.022784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:23.023230 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:23.024157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:23.024613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:23.186345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:23.194193 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d18d577d-1d8f-4231-a641-accef576ae4b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1267 microversion: 2.1 time: 0.216314 Jun 24 08:21:23.194762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 225/460] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:22 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:23.224529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:23.233592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:23.235196 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:23.236437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d9ded1d3-a383-489b-a0af-0b438b468a47 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1753 microversion: 2.20 time: 0.225973 Jun 24 08:21:23.237052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 236/461] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:23 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1753 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:24.211121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:24.211733 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:24.218077 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:24.219547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:24.220345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:24.220767 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:24.256785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:24.257484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:24.264708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:24.265754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:24.266529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:24.266959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:24.402607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:24.410935 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cb111934-14cd-4fab-82e8-737d42c07bd3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1454 microversion: 2.1 time: 0.203812 Jun 24 08:21:24.411716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 226/462] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:24 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1454 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:21:24.428691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:24.430661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:24.438171 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:24.438756 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:24.439445 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:24.439726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:24.440308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:24.448286 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:24.449793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:24.450981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-224ba296-4a74-4e4a-ac36-bcbaec61b289 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1753 microversion: 2.20 time: 0.198071 Jun 24 08:21:24.451544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 237/463] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:24 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:24.577372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:24.586056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f55e7ac6-1187-43d7-8750-4b673432f470 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1454 microversion: 2.1 time: 0.162312 Jun 24 08:21:24.586614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 227/464] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:21:24 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:21:25.470150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:25.470694 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:25.477744 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:25.478483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:25.479261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:25.479873 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:25.969390 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:25.978392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:25.980024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:25.981206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dc37175f-83c3-480c-ae22-d5377eea980a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.515718 Jun 24 08:21:25.981953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 238/465] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:25 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:27.000657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:27.006635 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:27.007506 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:27.008028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:27.008895 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:27.009553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:27.162127 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-c09bc38e-94fb-43d3-823e-4e01b0526c35 req-89d2b0cc-dd8d-4fda-b0c0-c970195558a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401989f0-8369-4e86-92c8-76b65a93f9cb", "tag": "28a38618-88aa-4717-b585-2dc906547505"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:27.179069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-c09bc38e-94fb-43d3-823e-4e01b0526c35 req-89d2b0cc-dd8d-4fda-b0c0-c970195558a7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:27.179800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-c09bc38e-94fb-43d3-823e-4e01b0526c35 req-89d2b0cc-dd8d-4fda-b0c0-c970195558a7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:27.192727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-c09bc38e-94fb-43d3-823e-4e01b0526c35 req-89d2b0cc-dd8d-4fda-b0c0-c970195558a7 service nova] Creating event network-changed:28a38618-88aa-4717-b585-2dc906547505 for instance 401989f0-8369-4e86-92c8-76b65a93f9cb on hv-cinder-83482 Jun 24 08:21:27.201777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-c09bc38e-94fb-43d3-823e-4e01b0526c35 req-89d2b0cc-dd8d-4fda-b0c0-c970195558a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043437 Jun 24 08:21:27.203579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 239/466] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:21:27.235962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:27.244764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:27.246697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:27.248139 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-76a0b774-5059-468b-9b6d-6e19649e760f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.252577 Jun 24 08:21:27.249236 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 228/467] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:26 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:28.270226 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:28.271692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:28.279023 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:28.279695 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:28.282750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:28.283435 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:28.454527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:28.471546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:28.484396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:28.484396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3249fa14-89bf-4eef-b315-93c26b08a5d8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.211942 Jun 24 08:21:28.484396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 240/468] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:28 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:29.494899 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:29.495584 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:29.502479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:29.503066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:29.510595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:29.510595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:29.644261 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:29.655138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:29.657708 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:29.658882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-044d4e5b-56b9-4c89-b99c-64e75bbfb5d5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.167923 Jun 24 08:21:29.659488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 229/469] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:29 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:30.676644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:30.678520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:30.684377 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:30.684821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:30.685562 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:30.685991 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:30.828611 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:30.838696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:30.838696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:30.839662 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-74a07b76-08a0-4400-82de-ee8f5c7b3b72 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.166935 Jun 24 08:21:30.840222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 241/470] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:30 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:31.858653 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:31.859277 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:31.865943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:31.866383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:31.867139 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:31.867570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:32.003505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:32.012689 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:32.014289 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:32.015518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f5f0a1e7-48bd-48da-8dd7-52b3645b8438 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.160872 Jun 24 08:21:32.016158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 230/471] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:31 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:32.132143 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "764d5c20-c0fc-46c2-b760-eea804571515", "device": "/dev/sdb"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:32.134534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:32.142121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:32.142576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:32.144128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:32.144663 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:33.035127 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:33.035776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:33.042049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:33.042500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:33.043418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:33.043851 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:33.185860 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:33.195226 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:33.196769 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:33.197940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6efb874c-1132-4437-9d2d-d0234114129e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.167306 Jun 24 08:21:33.198567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 231/472] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:33 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:34.216884 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:34.217572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:34.224097 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:34.224566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:34.225316 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:34.225742 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:34.364560 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:34.374173 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:34.375814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:34.377149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-55980051-2e92-4d79-be69-fc337b8d6a85 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.164124 Jun 24 08:21:34.378803 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 232/473] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:34 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:35.397389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:35.398120 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:35.403972 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:35.404442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:35.405191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:35.405618 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:35.409521 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:35.552794 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:35.562046 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:35.563530 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:35.570569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ef3d07d3-3eb1-4b46-9db7-b24e7317f1b2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.171949 Jun 24 08:21:35.570569 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 233/474] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:35 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:36.586946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:36.587564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:36.593675 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:36.595193 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:36.595193 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:36.595520 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:36.730185 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:36.739623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:36.741143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:36.742311 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-31ac778b-c129-4bf1-8e01-74b0346596eb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.159456 Jun 24 08:21:36.743542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 234/475] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:36 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:37.761686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:37.762319 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:37.768244 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:37.768682 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:37.769470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:37.769948 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:37.904927 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:37.913621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:37.915114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:37.916364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-27631fd8-7fee-4cd3-a6a8-c36be6eb419d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.158506 Jun 24 08:21:37.916921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 235/476] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:37 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:38.935132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:38.935755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:38.941820 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:38.942881 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:38.943853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:38.944308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:39.079814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:39.090923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:39.091739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:39.092962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-60cd446f-e710-4d5b-994b-7cad71266a31 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.162056 Jun 24 08:21:39.093518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 236/477] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:38 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:39.224961 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7f95d15f-ac64-4379-aa79-93d4411f7027 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "POST /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.096860 Jun 24 08:21:39.225603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 242/478] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:21:32 2022] POST /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3/os-volume_attachments => generated 194 bytes in 7099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:40.111957 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:40.112567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:40.118987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:40.119497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:40.120311 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:40.120773 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:40.251604 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:40.260945 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:40.262432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:40.263572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c778d7f9-5b94-4c3c-9fd5-382f0ee7885e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.155514 Jun 24 08:21:40.264123 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 237/479] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:40 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:41.283852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:41.284557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:41.287700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=82 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:41.292587 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:41.293031 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:41.293773 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:41.294205 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:41.427310 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:41.436052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:41.437561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:41.438696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-37c48697-6061-4ab8-ae94-a9914a0a1194 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.159613 Jun 24 08:21:41.439252 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 243/480] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:41 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:42.457491 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:42.458093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:42.464486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:42.464930 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:42.465684 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:42.466113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:42.594730 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:42.603629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:42.605135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:42.606271 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fc921362-e56e-4a4d-a8e1-6ffc00b8865f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.152736 Jun 24 08:21:42.606823 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 238/481] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:42 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:43.625137 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:43.625734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:43.633260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:43.633707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:43.634474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:43.634905 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:43.768073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:43.777439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:43.779058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:43.780253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-795c5adb-6e1a-4f4e-b9cd-d25bed9e97ad tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.159107 Jun 24 08:21:43.781173 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 244/482] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:43 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:44.798693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:44.799298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:44.801333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=54 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:44.806140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:44.806564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:44.807322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:44.807755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:44.935306 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:44.943772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:44.945788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:44.946953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8b5a693f-6dab-446d-9caf-77a8d60949a4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.152272 Jun 24 08:21:44.947514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 239/483] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:44 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:45.965867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:45.967056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:45.973602 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:45.974056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:45.974808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:45.975272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:46.106927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:46.115307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:46.117025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:46.118203 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a477c31a-08d6-472c-9802-ee69250c757c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.156322 Jun 24 08:21:46.118764 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 245/484] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:45 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:47.135799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:47.136472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:47.142442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:47.142886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:47.143641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:47.144069 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:47.278625 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:47.287182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:47.288719 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:47.290741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ec1da6bf-2bec-4b4a-8d73-cec248cb0491 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.158861 Jun 24 08:21:47.291643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 240/485] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:47 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:48.309483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:48.310021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:48.316512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:48.316961 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:48.317716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:48.318157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:48.452078 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:48.460600 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:48.462093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:48.464242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-19aeff8c-a0c6-4055-b220-392191b098c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.158883 Jun 24 08:21:48.464823 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 246/486] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:48 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:49.483149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:49.483762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:49.489822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:49.490297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:49.491105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:49.491550 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:49.623676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:49.631907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:49.633427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:49.635328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fea854c9-a68b-4ea5-bce7-7a0390ac0321 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.156136 Jun 24 08:21:49.635898 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 241/487] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:49 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:50.654450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:50.655049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:50.661479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:50.661918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:50.662654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:50.663079 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:50.789423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:50.797683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:50.799180 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:50.800341 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0f585566-3655-4afb-8e8f-a4b276bfb34a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.150839 Jun 24 08:21:50.800886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 247/488] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:50 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:51.818863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:51.819457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:51.826023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:51.830091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:51.830091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:51.830091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:51.958442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:51.967447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:51.968991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:51.970138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-508d340c-bf5e-46f0-8bc4-c35ae0b31796 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.155203 Jun 24 08:21:51.970699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 242/489] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:51 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:52.757259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-010484d6-7af3-4748-97e2-b7545e1d214c req-f2f1339a-e38c-43a4-a2a3-b348b8bb2762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "name": "network-vif-plugged", "status": "completed", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:21:52.766991 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-010484d6-7af3-4748-97e2-b7545e1d214c req-f2f1339a-e38c-43a4-a2a3-b348b8bb2762 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:52.767522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-010484d6-7af3-4748-97e2-b7545e1d214c req-f2f1339a-e38c-43a4-a2a3-b348b8bb2762 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:52.770292 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:52.781136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-010484d6-7af3-4748-97e2-b7545e1d214c req-f2f1339a-e38c-43a4-a2a3-b348b8bb2762 service nova] Creating event network-vif-plugged:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:21:52.786447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-010484d6-7af3-4748-97e2-b7545e1d214c req-f2f1339a-e38c-43a4-a2a3-b348b8bb2762 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Jun 24 08:21:52.787548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 248/490] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:21:52.989156 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:52.989765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:52.995889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:52.996380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:52.997134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:52.997647 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:53.125270 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:53.133550 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:53.135549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:53.136725 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-68de2dc4-3fcc-4f74-8310-b775570a47df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.151508 Jun 24 08:21:53.137269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 243/491] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:52 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:54.156267 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:54.156954 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:54.163400 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:54.163848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:54.164633 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:54.165065 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:54.292534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:54.300995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:54.302480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:54.303611 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-21b8f2cb-611e-4274-beda-b30021def9b3 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.152442 Jun 24 08:21:54.304161 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 249/492] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:54 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:55.322926 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:55.323558 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:55.329575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:55.330009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:55.330750 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:55.331172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:55.459984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:55.469000 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:55.470496 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:55.471634 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b2d1fa98-f9c3-4e08-9b8e-54d05727b1e1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.152625 Jun 24 08:21:55.472183 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 244/493] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:55 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:56.490626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:56.491147 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:56.497327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:56.498761 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:56.499552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:56.499942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:56.628644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:56.637001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:56.639163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:56.640380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-03763978-b08e-4f56-8386-a715fda87422 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.153761 Jun 24 08:21:56.640931 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 250/494] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:56 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:21:57.659160 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:57.659795 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:57.665798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:57.666244 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:57.666992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:57.667423 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:57.800382 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:57.809093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:57.811259 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:57.812459 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-69e475bc-b8c2-4be6-9b44-d87b97ea9f68 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.157128 Jun 24 08:21:57.813014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 245/495] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:57 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:21:58.831535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:21:58.832142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:21:58.838701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:58.839094 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:58.839849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:21:58.840314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:21:58.968949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:58.977449 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:58.978984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:21:58.980152 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-46ac4231-64a1-4c06-966c-056ea5fd472b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.152532 Jun 24 08:21:58.980767 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 251/496] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:58 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:00.001766 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:00.002399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:00.008522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:00.008964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:00.009702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:00.010126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:00.140915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:00.149797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:00.151374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:00.152580 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-455b1a67-df2c-4e01-84a4-020198856a82 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.155300 Jun 24 08:22:00.153163 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 246/497] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:21:59 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:01.076995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:01.077582 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:01.083991 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.084471 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.085230 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.085665 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.108993 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f97f75bc-c9cf-426d-b4ff-aaa1eb176d56 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/ips" status: 200 len: 149 microversion: 2.1 time: 0.036494 Jun 24 08:22:01.109560 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 252/498] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:22:01 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:01.119775 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3d97859-c807-43ae-aeb7-2099b17f47e2"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:01.120950 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:01.126944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.133959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.133959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.133959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.170780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:01.171388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:01.177383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.177826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.178584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.179022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.207632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Invalid volume: volume c3d97859-c807-43ae-aeb7-2099b17f47e2 is already attached to instances: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: POST /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/os-volume_attachments HTTP/1.1 Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 74 Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:22:01.209969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {"volumeAttachment": {"volumeId": "c3d97859-c807-43ae-aeb7-2099b17f47e2"}} Jun 24 08:22:01.211780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Invalid volume: volume c3d97859-c807-43ae-aeb7-2099b17f47e2 is already attached to instances: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'server_id': 'c25911a0-62f3-4ceb-8e93-5a492c985fae', 'body': {'volumeAttachment': {'volumeId': 'c3d97859-c807-43ae-aeb7-2099b17f47e2'}}} Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c3d97859-c807-43ae-aeb7-2099b17f47e2 is already attached to instances: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:01.212661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c3d97859-c807-43ae-aeb7-2099b17f47e2 is already attached to instances: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:01.213859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c3d97859-c807-43ae-aeb7-2099b17f47e2 is already attached to instances: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 400 to user: Invalid volume: volume c3d97859-c807-43ae-aeb7-2099b17f47e2 is already attached to instances: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7e5bc788-f6e4-49b6-a4f5-479c57eafe72 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095555 Jun 24 08:22:01.215076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 247/499] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:22:01 2022] POST /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:22:01.221002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:01.221497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:01.228302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.228747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.229512 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.229944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.254699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:22:01.291268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:01.319550 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:01.329542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:01.331063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:01.332175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6072da07-c5cf-4844-975e-db720a93de2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.165353 Jun 24 08:22:01.332751 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 253/500] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:01 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:01.499759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7807bd59-3eb9-441b-a390-bb9eb43ec81b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 204 len: 0 microversion: 2.1 time: 0.282202 Jun 24 08:22:01.500394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 248/501] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:22:01 2022] DELETE /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:22:01.508329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:01.509218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:01.515770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.516226 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.516985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:01.517413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:01.660534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:01.668164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f246602a-ff9b-4054-851b-245d62b11a26 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1681 microversion: 2.1 time: 0.163679 Jun 24 08:22:01.668812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 254/502] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:01 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:02.351614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:02.352322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:02.358996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:02.359423 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:02.360332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:02.360706 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:02.496016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:02.507517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:02.511379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:02.511379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fd99e287-9679-4670-be0f-57179054963f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.162935 Jun 24 08:22:02.511379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 249/503] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:02 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:02.687877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:02.688457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:02.696086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:02.696564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:02.697330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:02.697759 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:02.826033 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:02.833384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8777dcde-d6e3-4b3f-983d-69173cb873e4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1681 microversion: 2.1 time: 0.150483 Jun 24 08:22:02.835523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 255/504] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:02 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:03.530499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:03.535958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:03.537510 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:03.537947 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:03.538694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:03.539118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:03.671214 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:03.679950 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:03.681565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:03.682706 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4b27c109-b0a6-409e-9826-0ee3cd7f8bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1809 microversion: 2.20 time: 0.157290 Jun 24 08:22:03.683259 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 250/505] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:03 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:03.851522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:03.852259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:03.858975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:03.859424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:03.860188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:03.860656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:03.991678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:03.999950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-08524d13-52b1-4111-8c92-18c41fe79065 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1681 microversion: 2.1 time: 0.153445 Jun 24 08:22:04.000557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 256/506] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:03 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:04.702419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:04.703308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:04.709462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:04.709902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:04.710661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:04.711084 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:04.857796 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:04.868897 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:04.870680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:04.878507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:04.880291 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:04.885634 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b644ea2e-c209-4e47-ac47-afb3aadd6643 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1796 microversion: 2.20 time: 0.174212 Jun 24 08:22:04.890948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:04.891639 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:04.892881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:04.893446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:04.908097 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 251/507] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:04 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1796 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:04.915184 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-cd17aa0c-56b7-49ce-9615-41ef464b4336 req-54a75760-dbd5-4ad7-ac0e-e8904a221971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25911a0-62f3-4ceb-8e93-5a492c985fae", "name": "network-vif-deleted", "tag": "88e3b09c-5211-435b-a4f7-a0439b4d71c3"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:04.925742 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-cd17aa0c-56b7-49ce-9615-41ef464b4336 req-54a75760-dbd5-4ad7-ac0e-e8904a221971 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:04.927442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-cd17aa0c-56b7-49ce-9615-41ef464b4336 req-54a75760-dbd5-4ad7-ac0e-e8904a221971 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:04.940332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-cd17aa0c-56b7-49ce-9615-41ef464b4336 req-54a75760-dbd5-4ad7-ac0e-e8904a221971 service nova] Creating event network-vif-deleted:88e3b09c-5211-435b-a4f7-a0439b4d71c3 for instance c25911a0-62f3-4ceb-8e93-5a492c985fae on hv-cinder-83482 Jun 24 08:22:04.945972 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-cd17aa0c-56b7-49ce-9615-41ef464b4336 req-54a75760-dbd5-4ad7-ac0e-e8904a221971 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035681 Jun 24 08:22:04.947018 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 252/508] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:05.024080 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:05.025209 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:05.033498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:05.034514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:05.035850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:05.036551 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:05.048543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lazy-loading 'services' on Instance uuid 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:05.138364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:05.149393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-751d7eb7-0ebc-4287-9bb4-6f7acf80b7af tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1613 microversion: 2.1 time: 0.135538 Jun 24 08:22:05.156441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 253/509] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:05 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1613 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:05.357309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e46c58e2-9481-4352-b399-29c14819746d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "DELETE /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3/os-volume_attachments/764d5c20-c0fc-46c2-b760-eea804571515" status: 202 len: 0 microversion: 2.1 time: 0.482440 Jun 24 08:22:05.361563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 257/510] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:22:04 2022] DELETE /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3/os-volume_attachments/764d5c20-c0fc-46c2-b760-eea804571515 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:06.166946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:06.167597 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:06.175024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:06.175467 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:06.176249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:06.176697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:06.212360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:06.212804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:06.213257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid c25911a0-62f3-4ceb-8e93-5a492c985fae {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:06.256076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:06.264424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5e61aa4f-44e4-45c5-917f-baea0ad17bca tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 200 len: 1331 microversion: 2.1 time: 0.101270 Jun 24 08:22:06.265002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 254/511] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:06 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:07.283135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:07.283862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:07.290059 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:07.290549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:07.291299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:07.291731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:07.305133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae HTTP/1.1 Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:22:07.306707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:22:07.308664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'c25911a0-62f3-4ceb-8e93-5a492c985fae'} Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:22:07.309515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:22:07.310850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:07.312439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:22:07.312439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0b5846ef-b267-422e-94bb-54589cadf393 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 404 len: 111 microversion: 2.1 time: 0.030535 Jun 24 08:22:07.312439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 258/512] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:07 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:22:07.317201 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-126be506-205c-4cee-b920-3a6b5f6c977f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '.version_select at 0x7f1496354c10>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:07.413737 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-126be506-205c-4cee-b920-3a6b5f6c977f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145702587" status: 202 len: 0 microversion: 2.1 time: 0.100352 Jun 24 08:22:07.414295 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 255/513] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 24 08:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145702587 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:07.553770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:07.560737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:07.560737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:07.561062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:07.561817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:07.562251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:07.587207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:22:07.933673 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a297cff4-1d86-40e2-b4ba-61bb479fff44 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "DELETE /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 204 len: 0 microversion: 2.1 time: 0.383220 Jun 24 08:22:07.935549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 259/514] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:22:07 2022] DELETE /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:22:07.943807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:07.952659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:07.952659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:07.952659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:07.952659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:07.953050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:08.085308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:08.094487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-426c6cea-797c-4c4a-a92d-00d28e80e26d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1513 microversion: 2.1 time: 0.154768 Jun 24 08:22:08.095057 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 256/515] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:07 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:08.210351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:08.218939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:08.218939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:08.218939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:08.218939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:08.219303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:08.299602 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'services' on Instance uuid a4879e55-2bc5-4df2-b495-a4ba5f0c98fa {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:08.486460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dc9ae14a-20a0-4311-86c0-21fc72927a66 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments/c3d97859-c807-43ae-aeb7-2099b17f47e2" status: 202 len: 0 microversion: 2.1 time: 0.280093 Jun 24 08:22:08.487073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 260/516] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:22:08 2022] DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments/c3d97859-c807-43ae-aeb7-2099b17f47e2 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:08.495278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:08.496308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:08.502916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:08.503358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:08.504108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:08.504636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:08.533661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3d455e44-a457-4344-aa76-a4be9e1bb4d9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Jun 24 08:22:08.534202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 257/517] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:22:08 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:09.113216 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:09.113924 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:09.120187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:09.120664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:09.121424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:09.121861 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:09.260263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:09.267718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f355d650-82f4-4320-b3f0-dc715ac2ae46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1513 microversion: 2.1 time: 0.158751 Jun 24 08:22:09.268301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 261/518] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:09 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:09.547376 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:09.548374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:09.556679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:09.557123 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:09.557882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:09.558308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:09.599293 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e9af75d1-44ff-406c-8c0e-f2bc59f5f629 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057655 Jun 24 08:22:09.600320 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 258/519] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:22:09 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:10.285669 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:10.286270 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:10.292801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:10.293266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:10.294002 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:10.294464 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:10.433779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:10.442272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-95b6621d-06e5-4fb2-89db-f3c562b22ed1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1513 microversion: 2.1 time: 0.160481 Jun 24 08:22:10.442835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 262/520] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:10 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:10.613574 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:10.614481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:10.621611 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:10.622594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:10.623528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:10.624114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:10.657078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-56bb6827-d337-48ee-a445-e687f542d6e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047321 Jun 24 08:22:10.657666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 259/521] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:22:10 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:11.032210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-7c9ec60e-f876-46be-86b6-c197f43602da req-f0dd5bfc-ffea-421e-b17c-9d2995bb33e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860c6adc-4385-4cae-8bf0-5d9c1cbb29a3", "name": "network-vif-deleted", "tag": "2b655029-389e-40c2-9cd7-9df1b683c516"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:11.040339 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7c9ec60e-f876-46be-86b6-c197f43602da req-f0dd5bfc-ffea-421e-b17c-9d2995bb33e8 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.040783 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7c9ec60e-f876-46be-86b6-c197f43602da req-f0dd5bfc-ffea-421e-b17c-9d2995bb33e8 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.055531 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-7c9ec60e-f876-46be-86b6-c197f43602da req-f0dd5bfc-ffea-421e-b17c-9d2995bb33e8 service nova] Creating event network-vif-deleted:2b655029-389e-40c2-9cd7-9df1b683c516 for instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 on hv-cinder-83482 Jun 24 08:22:11.061338 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-7c9ec60e-f876-46be-86b6-c197f43602da req-f0dd5bfc-ffea-421e-b17c-9d2995bb33e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Jun 24 08:22:11.061993 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 263/522] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:11.460571 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:11.461170 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:11.467646 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.468082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.468856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.469287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.499856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.500360 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.500838 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lazy-loading 'fault' on Instance uuid 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:11.541853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:11.550294 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3abc874d-405a-416a-8cea-2781ce425757 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 200 len: 1308 microversion: 2.1 time: 0.093563 Jun 24 08:22:11.550844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 260/523] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:11 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:11.669364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:11.670343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:11.672790 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:11.677619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.678059 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.678807 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.679274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.683038 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:11.707758 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6c8cf166-f2da-403f-a839-45f0ee2c3c19 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042818 Jun 24 08:22:11.708327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 264/524] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:22:11 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:22:11.765218 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:11.765710 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:11.771566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.776031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.776031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:11.776031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:11.798697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:22:12.139466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-738996fb-a5c3-4965-bb46-3e0236cef352 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 204 len: 0 microversion: 2.1 time: 0.377732 Jun 24 08:22:12.140328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 261/525] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:22:11 2022] DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:22:12.149245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:12.149877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:12.157731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:12.158181 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:12.158944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:12.159376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:12.288428 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:12.296470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-533cff06-2e24-4bd8-92b9-23138cd4ade3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1681 microversion: 2.1 time: 0.151395 Jun 24 08:22:12.297040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 265/526] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:12 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:12.572927 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:12.573622 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:12.580429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:12.580879 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:12.581627 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:12.582098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:12.596010 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] HTTP exception thrown: Instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 could not be found. Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Request method failure captured: Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 HTTP/1.1 Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXPekXG3rg9XRHhtUWIGHyp1Bew17WIZG5c306EEQT_XXQq7wETV4SlrT4RCtHgh4q-N6tL2D86yCAachTmzhEz4JVjNBkVrvHe0js6H0nB3h-mdyjxKla7ifLuenb_3D0-Lrb5tLN2XfuSoD9MkI5EuhR5jKmZjbe66mrmq6UfbMDs Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: dae6efd4ad46479cb965caa8a97a772a Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesSnapshotTestJSON-338857145 Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:22:12.597659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dae6efd4ad46479cb965caa8a97a772a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dae6efd4ad46479cb965caa8a97a772a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dae6efd4ad46479cb965caa8a97a772a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dae6efd4ad46479cb965caa8a97a772a"}]}] Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesSnapshotTestJSON-338857145 Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: dae6efd4ad46479cb965caa8a97a772a Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-338857145 Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesSnapshotTestJSON-338857145-project Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 69533891e4cf463bb3fe9ac5cf7f4215 Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesSnapshotTestJSON-338857145-project Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 could not be found. Jun 24 08:22:12.599191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '860c6adc-4385-4cae-8bf0-5d9c1cbb29a3'} Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 could not be found. Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:22:12.600075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 could not be found. Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 could not be found. Jun 24 08:22:12.601531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:22:12.602910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Returning 404 to user: Instance 860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:22:12.602910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-14687b11-8db1-44df-99c2-416ff66fdbce tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3" status: 404 len: 111 microversion: 2.1 time: 0.030463 Jun 24 08:22:12.602910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 262/527] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:12 2022] GET /compute/v2.1/servers/860c6adc-4385-4cae-8bf0-5d9c1cbb29a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:22:13.314841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:13.315475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:13.322561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:13.323005 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:13.323753 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:13.324186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:13.452530 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:13.459953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-79c5659e-6405-4cf6-9ab8-5591db99aee5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1681 microversion: 2.1 time: 0.149318 Jun 24 08:22:13.460547 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 266/528] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:13 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:14.477200 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:14.477715 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:14.483705 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:14.484145 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:14.484923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:14.485380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:14.613918 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:14.621345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-259ba68e-c2f3-402b-bec3-8b67d67a6d97 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1681 microversion: 2.1 time: 0.148064 Jun 24 08:22:14.622523 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 263/529] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:14 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:14.671220 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa756d79-8e9a-45fd-a626-e1157882dfe3"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:14.672324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:14.678692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:14.679138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:14.679893 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:14.680354 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:15.639104 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:15.639744 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:15.641732 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:15.646646 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:15.647091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:15.647873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:15.648355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:15.775245 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:15.779116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:15.783285 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e1c85779-36a1-4914-be30-e3dc73689894 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1681 microversion: 2.1 time: 0.148327 Jun 24 08:22:15.794941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 264/530] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:15 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:16.801249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:16.801903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:16.809031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:16.809487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:16.810288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:16.810799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:16.952902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:16.964257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-07bdda8d-a265-4f62-9bae-fcb4039ee05b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1681 microversion: 2.1 time: 0.163173 Jun 24 08:22:16.964257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 265/531] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:16 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:17.074446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b578f190-4b73-40f8-9708-4df415ef045f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.407534 Jun 24 08:22:17.076341 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 267/532] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:22:14 2022] POST /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments => generated 194 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:22:17.979505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:17.980802 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:17.987916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:17.988393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:17.989201 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:17.989781 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:18.052507 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:18.060829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7a96a637-2358-4996-9c54-8201b9168b16 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1613 microversion: 2.1 time: 0.086032 Jun 24 08:22:18.061688 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:17 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:18.220010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-344bc0b2-757e-46b4-ad99-8f8d79da88e3 req-ab4d4c24-8498-4c19-8208-bf6faad3f77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4879e55-2bc5-4df2-b495-a4ba5f0c98fa", "name": "network-vif-deleted", "tag": "5f99fb72-376e-4446-ad42-3753371001b5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:18.238468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-344bc0b2-757e-46b4-ad99-8f8d79da88e3 req-ab4d4c24-8498-4c19-8208-bf6faad3f77a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:18.239391 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-344bc0b2-757e-46b4-ad99-8f8d79da88e3 req-ab4d4c24-8498-4c19-8208-bf6faad3f77a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:18.253788 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-344bc0b2-757e-46b4-ad99-8f8d79da88e3 req-ab4d4c24-8498-4c19-8208-bf6faad3f77a service nova] Creating event network-vif-deleted:5f99fb72-376e-4446-ad42-3753371001b5 for instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa on hv-cinder-83482 Jun 24 08:22:18.260365 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-344bc0b2-757e-46b4-ad99-8f8d79da88e3 req-ab4d4c24-8498-4c19-8208-bf6faad3f77a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048191 Jun 24 08:22:18.261923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 268/534] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:19.079456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:19.080049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:19.086198 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:19.086632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:19.087385 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:19.087811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:19.127852 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:19.128327 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:19.128764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid a4879e55-2bc5-4df2-b495-a4ba5f0c98fa {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:19.170534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:19.178094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-71eacc20-3d75-4b19-a9ed-dfdd19fc74a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 200 len: 1331 microversion: 2.1 time: 0.103658 Jun 24 08:22:19.179914 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:19 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:20.197141 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:20.197791 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:20.205176 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:20.205627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:20.206380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:20.206815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:20.219836 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa HTTP/1.1 Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:22:20.221475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:22:20.223148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'a4879e55-2bc5-4df2-b495-a4ba5f0c98fa'} Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:22:20.223950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:22:20.225508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:20.226864 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:22:20.226864 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fbb5d8af-9fed-4c1a-8773-2fe54e2a1572 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 404 len: 111 microversion: 2.1 time: 0.030319 Jun 24 08:22:20.226864 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 269/536] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:20 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:22:20.232215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c2144600-9390-42b7-838a-e07b842d7cf8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '.version_select at 0x7f14963264c0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:20.322593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c2144600-9390-42b7-838a-e07b842d7cf8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233394706" status: 202 len: 0 microversion: 2.1 time: 0.094600 Jun 24 08:22:20.323169 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 268/537] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 24 08:22:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233394706 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:21.117968 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a9eac49c-280d-4297-a81e-5a1f33d0563c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: .version_select at 0x7f14961833a0>, body: {"keypair": {"name": "tempest-keypair-1139581554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw6MlVwnoYIpmYmJNpBn0f6a3bR5CftBj4cQOpOtCvRcwN6gIvKBzoGfPckE04kPdaUDG9LDVFEVdE1y4r5sQiadklvbqHP1sRSTeOoOW+ignX+4XLN1a1K22nO1XJOXA=="}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:21.132222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-a9eac49c-280d-4297-a81e-5a1f33d0563c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:22:21.135881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-a9eac49c-280d-4297-a81e-5a1f33d0563c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:22:21.231738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a9eac49c-280d-4297-a81e-5a1f33d0563c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116847 Jun 24 08:22:21.232542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 270/538] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:22:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:22.204338 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:22.204879 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:22.210974 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:22.211418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:22.212181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:22.212635 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:22.338754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lazy-loading 'services' on Instance uuid 47798514-cc6d-44cd-bb83-cc051cd57531 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:22.612829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9032ad25-7924-476e-9b7b-ad4da66b249e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-volume_attachments/a34786a5-318e-4cbd-a292-6b30f03bd447" status: 202 len: 0 microversion: 2.1 time: 0.412997 Jun 24 08:22:22.613430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 269/539] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:22:22 2022] DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-volume_attachments/a34786a5-318e-4cbd-a292-6b30f03bd447 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:23.072953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1233000182", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "networks": [{"uuid": "96a4491d-88f3-4f8d-8921-4250acd08643"}]}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:23.125920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] validate_networks() for [('96a4491d-88f3-4f8d-8921-4250acd08643', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:22:23.640436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:22:23.640859 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:22:23.641327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:22:23.641732 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:22:23.642141 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:22:23.650960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:23.651405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:23.652214 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:23.653298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:23.670475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Getting quotas for project dae6efd4ad46479cb965caa8a97a772a. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:22:23.674557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Getting quotas for user 69533891e4cf463bb3fe9ac5cf7f4215 and project dae6efd4ad46479cb965caa8a97a772a. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:22:23.692418 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:22:23.694925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:22:23.792382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9651082e-7f19-4dba-af38-91ebeb3e97b6 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723548 Jun 24 08:22:23.793216 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 271/540] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:22:23.806334 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4a69a76e-9834-4523-a581-38348b03f3d9 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:23.808050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4a69a76e-9834-4523-a581-38348b03f3d9 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:23.903817 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4a69a76e-9834-4523-a581-38348b03f3d9 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:23.911227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4a69a76e-9834-4523-a581-38348b03f3d9 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1219 microversion: 2.1 time: 0.111624 Jun 24 08:22:23.912237 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 270/541] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:23 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:24.129040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-696365847", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7"}], "security_groups": [{"name": "tempest-securitygroup--958736586"}], "key_name": "tempest-keypair-1139581554", "user_data": "}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:24.237708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] validate_networks() for [('be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:22:24.614892 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:22:24.615309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:22:24.615801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:22:24.616218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:22:24.616643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:22:24.625378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:24.625819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:24.626597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:24.627020 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:24.644215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:22:24.647888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:22:24.659829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:22:24.661994 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:22:24.804362 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4520b8bf-e1c0-4420-aefc-f595542f3ff1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.679665 Jun 24 08:22:24.805005 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 272/542] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:22:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:22:24.816531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0a4fd1e5-e56e-43c3-864f-9789a29ae0bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:24.817190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0a4fd1e5-e56e-43c3-864f-9789a29ae0bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:24.879803 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0a4fd1e5-e56e-43c3-864f-9789a29ae0bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:24.886489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0a4fd1e5-e56e-43c3-864f-9789a29ae0bf tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1241 microversion: 2.1 time: 0.073660 Jun 24 08:22:24.888281 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 271/543] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:24 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:24.928949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:24.930108 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:24.938246 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:24.938936 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:24.939883 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:24.940563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:25.004113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:25.012999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f1f0f98e-36f7-42a2-b001-51d5bada323d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1223 microversion: 2.1 time: 0.087127 Jun 24 08:22:25.016126 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 273/544] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:24 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:25.729339 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:25.730363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:25.737488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:25.737933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:25.740298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:25.740298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:25.761067 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'flavor' on Instance uuid 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:25.904847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:25.905451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:25.911802 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:25.912279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:25.913139 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:25.913516 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:25.994494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:26.002413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-172bdc54-84cf-4441-891e-2600b142c60c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1245 microversion: 2.1 time: 0.101411 Jun 24 08:22:26.002972 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 274/545] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:25 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:26.030131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:26.030731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:26.036690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:26.037133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:26.041715 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:26.041715 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:26.103779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:26.111611 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-20f7b5f2-382a-45d2-b8a2-62eaa1d097bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1271 microversion: 2.1 time: 0.085869 Jun 24 08:22:26.112189 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 275/546] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:26 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:26.188784 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e2c2e020-9950-4b96-bf60-982959dd075f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/action" status: 200 len: 32 microversion: 2.1 time: 0.463283 Jun 24 08:22:26.189390 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 272/547] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:22:25 2022] POST /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:22:26.198202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:26.198799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:26.206071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:26.206513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:26.207268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:26.207710 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:26.348485 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:26.357506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0c9c9d48-b245-470e-9165-fe181b92ac77 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.163062 Jun 24 08:22:26.358076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 276/548] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:26 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:26.909732 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-751bbb7d-d021-4b1d-8e75-20a41d34c7cd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:26.916473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-751bbb7d-d021-4b1d-8e75-20a41d34c7cd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:26.916917 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-751bbb7d-d021-4b1d-8e75-20a41d34c7cd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:26.979701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-751bbb7d-d021-4b1d-8e75-20a41d34c7cd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Going to try to stop instance {{(pid=118295) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 08:22:27.018799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:27.019510 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:27.026035 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.026484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.027245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.028170 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.091404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:27.098954 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3d1a7840-e620-4043-b3c9-f78c1812c3ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1293 microversion: 2.1 time: 0.084007 Jun 24 08:22:27.099529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 277/549] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:27 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:27.128527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:27.129231 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:27.135637 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.136900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.137757 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.138196 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.204486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:27.212063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0900a3b4-00a1-441a-b941-be435f5bbe46 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1277 microversion: 2.1 time: 0.087404 Jun 24 08:22:27.212671 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 278/550] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:27 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:27.244441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-751bbb7d-d021-4b1d-8e75-20a41d34c7cd tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action" status: 202 len: 0 microversion: 2.1 time: 0.338923 Jun 24 08:22:27.245205 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 273/551] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:22:26 2022] POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:27.253620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:27.254222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:27.260605 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.261053 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.262447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.262923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.376889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:27.378056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:27.386084 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.387666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.388734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:27.389882 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:27.395028 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:27.405881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3e6bdb0d-db9d-4cad-9eb2-1ec4979163ac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.156064 Jun 24 08:22:27.415968 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 279/552] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:27 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:27.545783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:27.555910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fbe4f48f-7648-48d8-a226-efee73229c06 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.184585 Jun 24 08:22:27.556521 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 274/553] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:27 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:28.117263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:28.117871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:28.124274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.124718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.125473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.125915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.206902 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:28.216188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-89a17f5a-9456-4eaa-af1f-0cf0c45adbf6 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1301 microversion: 2.1 time: 0.102778 Jun 24 08:22:28.216990 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 280/554] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:28 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:28.231227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:28.231624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:28.238097 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.238542 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.241596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.241596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.374695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:28.382345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0a1e739b-1ad6-482f-b1d1-9bca6fa274e1 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.155447 Jun 24 08:22:28.382912 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 275/555] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:28 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:28.422921 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:28.423573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:28.429607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.430045 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.430789 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.431264 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.563188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:28.573075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1ed32119-d916-48c8-ac09-c0550bafa1eb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.153980 Jun 24 08:22:28.573944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 281/556] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:28 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:28.575966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:28.576880 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:28.583625 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.584564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.585626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:28.586458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:28.722491 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:28.730612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bfbe25fa-3138-4e87-a43d-d58e3bc69fc2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.160960 Jun 24 08:22:28.731348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 276/557] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:28 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:29.233413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:29.234010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:29.240948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.241126 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.241859 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.242291 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.271877 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-f29221e2-f4a3-492d-af7a-e99cc809bd50 req-acc09b2e-af15-4a77-bd8f-52e3223500c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7d9be6-b120-49bf-bf5a-6abf47f52e34", "tag": "ebb1f926-526f-4167-bc22-2fae3e150bd4"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:29.294976 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-f29221e2-f4a3-492d-af7a-e99cc809bd50 req-acc09b2e-af15-4a77-bd8f-52e3223500c3 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.301749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-f29221e2-f4a3-492d-af7a-e99cc809bd50 req-acc09b2e-af15-4a77-bd8f-52e3223500c3 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.307806 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-f29221e2-f4a3-492d-af7a-e99cc809bd50 req-acc09b2e-af15-4a77-bd8f-52e3223500c3 service nova] Creating event network-changed:ebb1f926-526f-4167-bc22-2fae3e150bd4 for instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 on hv-cinder-83482 Jun 24 08:22:29.313346 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-f29221e2-f4a3-492d-af7a-e99cc809bd50 req-acc09b2e-af15-4a77-bd8f-52e3223500c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045360 Jun 24 08:22:29.314679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 277/558] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:22:29.316708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:29.326422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-823e1d6e-a9a9-4652-bed6-62bf88b69e7c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1299 microversion: 2.1 time: 0.096908 Jun 24 08:22:29.327033 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 282/559] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:29 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:29.401900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:29.403570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:29.411024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.411519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.412313 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.412913 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.560324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:29.574559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-21c47dd3-5428-45cb-98a6-3c0214be7270 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.178014 Jun 24 08:22:29.575396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 278/560] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:29 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:29.591230 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:29.592084 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:29.598612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.609689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.609689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.609689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.625826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:29.740561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:29.747586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:29.749266 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:29.754652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.755277 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.755809 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-54369c8c-b4f5-4d57-bba2-28bd31a51fa7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.168447 Jun 24 08:22:29.756307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:29.756845 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:29.757520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 283/561] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:29 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:29.900188 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:29.908967 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6a12cec8-abbf-4e49-a771-c25c761eddbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.165807 Jun 24 08:22:29.909536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 279/562] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:29 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:30.345320 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:30.346880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:30.354484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.354974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.355796 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.356318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.507755 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:30.517971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-86d24975-12c8-4de5-b7a8-7a7199fdd1e0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.177919 Jun 24 08:22:30.518914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 284/563] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:30 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:30.591536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:30.592185 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:30.599243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.599689 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.600494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.600936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.735141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:30.745106 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7f8f6bfc-2352-4de9-84fd-9fb8bd82948c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.157884 Jun 24 08:22:30.746586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 280/564] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:30 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:30.773846 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:30.774483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:30.783130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.783659 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.784460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.784889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.925176 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:30.927093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:30.927547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:30.932594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6c0f1b75-b8be-4a29-af95-b6bbab3ea01a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.162862 Jun 24 08:22:30.933155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 285/565] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:30 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:30.933561 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.934344 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.935028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:30.935185 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:30.939284 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:31.062813 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:31.070491 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b107400d-d537-4746-9044-df446f71a031 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.147547 Jun 24 08:22:31.071051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 281/566] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:30 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:31.328777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-e1e64d61-6ed5-4913-96de-7418feca8f12 req-e5dd045f-2b4a-4c6e-9106-8785f75a976c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb69e2f-11a1-4083-9b37-e10f77cc3ce0", "tag": "83d7f299-eea9-449a-ab6f-539ebb3654ea"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:31.337068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e1e64d61-6ed5-4913-96de-7418feca8f12 req-e5dd045f-2b4a-4c6e-9106-8785f75a976c service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.337515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e1e64d61-6ed5-4913-96de-7418feca8f12 req-e5dd045f-2b4a-4c6e-9106-8785f75a976c service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:31.348689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-e1e64d61-6ed5-4913-96de-7418feca8f12 req-e5dd045f-2b4a-4c6e-9106-8785f75a976c service nova] Creating event network-changed:83d7f299-eea9-449a-ab6f-539ebb3654ea for instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 on hv-cinder-83482 Jun 24 08:22:31.353561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-e1e64d61-6ed5-4913-96de-7418feca8f12 req-e5dd045f-2b4a-4c6e-9106-8785f75a976c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028464 Jun 24 08:22:31.354133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 286/567] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:31.534715 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:31.535317 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:31.542154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.542630 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:31.543372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.543750 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:31.673555 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:31.681417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1d6e339b-2925-4094-a2d2-6495d156e950 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.150534 Jun 24 08:22:31.681977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 282/568] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:31 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:31.763380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:31.764068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:31.770327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.770773 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:31.771518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.771945 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:31.908589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:31.916058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-380cac00-396b-4828-98b0-4ccdf8f63297 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.157360 Jun 24 08:22:31.916745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 287/569] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:31 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:31.951383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:31.951985 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:31.958139 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.958588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:31.959342 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:31.959772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:32.088630 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:32.089318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:32.089445 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:32.095646 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:32.097195 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c413326f-fddb-4ff7-bdb1-205dee02ca0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.150219 Jun 24 08:22:32.097769 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 283/570] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:31 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:32.100451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:32.101358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:32.101869 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:32.235892 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:32.243883 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0fb4f021-9a30-41d9-800a-0e022d507a63 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.159244 Jun 24 08:22:32.245073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 288/571] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:32 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:32.697438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:32.697976 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:32.704446 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:32.704881 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:32.707209 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:32.707644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:32.836729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:32.844714 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-809d151a-fa31-4c71-a0cd-6713b2458cda tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.151163 Jun 24 08:22:32.845274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 284/572] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:32 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:32.933501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:32.934821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:32.941478 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:32.941929 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:32.942689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:32.943123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:33.080592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:33.088061 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f21c194b-3afc-4b8c-9aeb-04fcdf491479 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.158637 Jun 24 08:22:33.088667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 289/573] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:32 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:33.114627 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:33.115226 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:33.121817 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:33.122375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:33.123129 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:33.123562 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:33.252771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:33.260528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-340dbd31-a167-418d-9f2a-104122d9f85f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.149691 Jun 24 08:22:33.261284 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 285/574] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:33 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:33.262706 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:33.263321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:33.269369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:33.269816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:33.270566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:33.270996 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:33.403727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:33.411635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3bef4298-8ce2-40a3-b22c-e540099f37e5 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.153484 Jun 24 08:22:33.412216 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 290/575] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:33 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:33.861223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:33.861745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:33.867609 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:33.868043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:33.868816 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:33.869241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.000536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:34.008118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2d77906a-f239-45e6-b83d-2df847ffd6f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.150762 Jun 24 08:22:34.008712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 286/576] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:33 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:34.103866 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:34.104487 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:34.110930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:34.111575 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.112095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:34.112539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.239167 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:34.247202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9d3f8857-93c8-4254-a291-a9e0a387fd58 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.147042 Jun 24 08:22:34.247751 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 291/577] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:34 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:34.277946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:34.278540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:34.284371 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:34.284810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.285549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:34.285970 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.416226 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:34.424132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3cb1cc62-706e-43d2-9ae4-806e92888780 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.149926 Jun 24 08:22:34.424799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 287/578] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:34 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:34.429351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:34.430387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:34.436729 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:34.437179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.437935 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:34.438368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:34.569203 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:34.577225 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-eff9f51d-8991-4cbc-a890-27bca1c16898 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.151725 Jun 24 08:22:34.577793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 292/579] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:34 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:35.024994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:35.025605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:35.029022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:35.032586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.033037 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.033807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.034244 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.163575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:35.171128 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-17778236-ca5c-4691-b33c-44008d9a6958 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.149983 Jun 24 08:22:35.171692 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 288/580] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:35 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:35.264685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:35.265324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:35.267253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=4 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:35.267939 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=16 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:35.273238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.273685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.274467 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.274902 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.411635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:35.419065 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d6a4a34f-0753-4382-ad04-bf4bc0bcc54a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.158998 Jun 24 08:22:35.419624 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 293/581] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:35 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:35.441298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:35.441907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:35.447829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.448251 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.449780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.450221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.580109 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:35.589024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8255e187-dfb0-496b-a6ce-a50e30360cde tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.150587 Jun 24 08:22:35.589024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 289/582] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:35 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:35.595069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:35.595684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:35.597585 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:35.603781 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.604274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.606973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:35.606973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:35.740419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:35.749031 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-eb94b85c-c4ec-4fa0-9577-2427a774f71f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.158205 Jun 24 08:22:35.749599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 294/583] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:35 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:36.188103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:36.189009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:36.194997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.195445 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.196213 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.196653 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.326503 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:36.333781 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-923323a0-22d3-4441-8297-b8e658592e5f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.149493 Jun 24 08:22:36.334340 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 290/584] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:36 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:36.435945 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:36.436608 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:36.442970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.443415 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.444165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.444621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.571065 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:36.579285 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-27a033de-f5ae-4d3a-baec-3fd7e2000b68 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.147705 Jun 24 08:22:36.579888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 295/585] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:36 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:36.606065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:36.606662 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:36.612651 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.613280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.614042 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.614504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.743902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:36.752163 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4bc222ae-9026-461e-9af7-0bb360428301 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.150258 Jun 24 08:22:36.752740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 291/586] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:36 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:36.766421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:36.767040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:36.772928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.773378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.774126 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:36.774558 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:36.903340 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:36.911501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a4cd8563-fe33-4669-8323-71e3d10a3a8e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.148869 Jun 24 08:22:36.912272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 296/587] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:36 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:37.137253 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-968445c1-2e12-4ecd-adef-2a37d7cd0c4a req-84174a8d-412d-4af5-98c2-a8e3a8f745e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7d9be6-b120-49bf-bf5a-6abf47f52e34", "name": "network-vif-plugged", "status": "completed", "tag": "ebb1f926-526f-4167-bc22-2fae3e150bd4"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:37.145405 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-968445c1-2e12-4ecd-adef-2a37d7cd0c4a req-84174a8d-412d-4af5-98c2-a8e3a8f745e9 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.145846 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-968445c1-2e12-4ecd-adef-2a37d7cd0c4a req-84174a8d-412d-4af5-98c2-a8e3a8f745e9 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.157048 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-968445c1-2e12-4ecd-adef-2a37d7cd0c4a req-84174a8d-412d-4af5-98c2-a8e3a8f745e9 service nova] Creating event network-vif-plugged:ebb1f926-526f-4167-bc22-2fae3e150bd4 for instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 on hv-cinder-83482 Jun 24 08:22:37.162362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-968445c1-2e12-4ecd-adef-2a37d7cd0c4a req-84174a8d-412d-4af5-98c2-a8e3a8f745e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028643 Jun 24 08:22:37.162710 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 292/588] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:37.351137 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:37.351663 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:37.358833 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.359278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.360038 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.360502 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.492491 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:37.500416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-15971855-a04a-4bd4-9378-ee93efa2dea4 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.153124 Jun 24 08:22:37.500982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 297/589] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:37 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:37.598419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:37.599107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:37.606391 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.606768 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.607705 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.608133 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.742868 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:37.751249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-692b556f-4f94-410f-960f-f6bfcd8a6033 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.157170 Jun 24 08:22:37.751800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 293/590] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:37 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:37.770072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:37.770676 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:37.777239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.777686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.778541 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.778972 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.911593 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:37.919686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a9327547-586c-4a0e-84b7-28d1dd5de766 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.153431 Jun 24 08:22:37.920262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 298/591] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:37 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:37.928115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:37.928780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:37.935029 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.939351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:37.939351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:37.939351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.064796 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:38.077182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7035ce02-338a-4624-a5c0-421adad46fc6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.148321 Jun 24 08:22:38.077182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 294/592] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:37 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:38.516501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:38.517141 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:38.523595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:38.524040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.524839 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:38.525271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.654079 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:38.661492 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-61282b69-1dcf-41be-8199-1895fbc5c3e3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.148862 Jun 24 08:22:38.662062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 299/593] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:38 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:38.768330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:38.768861 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:38.774763 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:38.775197 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.775933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:38.776461 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.911134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:38.918765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c8947d0b-3d84-4514-baf5-d9b10dcbaa21 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.154275 Jun 24 08:22:38.919326 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 295/594] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:38 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:38.937170 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:38.937802 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:38.943671 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:38.944119 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.944897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:38.945327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:38.960727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:39.075986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:39.083528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cd29d373-b5c7-495a-a882-ca0c8030056a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.150753 Jun 24 08:22:39.084453 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 300/595] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:38 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:39.089250 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:39.092747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:39.096122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.096601 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:39.097361 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.097796 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:39.193870 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-e89278d2-c88c-4576-b872-50e469385107 req-1a88e3ab-f430-4f37-8434-788a58e95247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb69e2f-11a1-4083-9b37-e10f77cc3ce0", "name": "network-vif-plugged", "status": "completed", "tag": "83d7f299-eea9-449a-ab6f-539ebb3654ea"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:39.203037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e89278d2-c88c-4576-b872-50e469385107 req-1a88e3ab-f430-4f37-8434-788a58e95247 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.203476 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e89278d2-c88c-4576-b872-50e469385107 req-1a88e3ab-f430-4f37-8434-788a58e95247 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:39.215232 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-e89278d2-c88c-4576-b872-50e469385107 req-1a88e3ab-f430-4f37-8434-788a58e95247 service nova] Creating event network-vif-plugged:83d7f299-eea9-449a-ab6f-539ebb3654ea for instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 on hv-cinder-83482 Jun 24 08:22:39.220765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-e89278d2-c88c-4576-b872-50e469385107 req-1a88e3ab-f430-4f37-8434-788a58e95247 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030562 Jun 24 08:22:39.221680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 301/596] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:22:39.241879 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:39.244117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b0792cc8-fd1e-44d7-8600-8298ddad7f7e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.158664 Jun 24 08:22:39.244731 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 296/597] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:39 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:39.678769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:39.679450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:39.685866 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.686308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:39.687051 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.687474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:39.818247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:39.825716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6a4306e3-e9d6-48d2-989f-1f290a445781 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.151626 Jun 24 08:22:39.826272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 302/598] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:39 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:39.935641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:39.936275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:39.942310 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.942772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:39.943517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:39.943945 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.074473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:40.081789 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-509f5a8d-b78b-4090-acd2-b25c88db355a tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1319 microversion: 2.1 time: 0.150440 Jun 24 08:22:40.082341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 297/599] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:39 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:40.100540 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:40.101139 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:40.107394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:40.107914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.108772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:40.109268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.239346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:40.247452 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fec8b24a-6e60-4df5-8f65-b19444b70ad7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.150652 Jun 24 08:22:40.248017 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 303/600] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:40 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:40.261043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:40.262216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:40.268046 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:40.268525 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.269276 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:40.269707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.288150 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:40.398008 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:40.406633 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d7876ed6-0948-42d4-9b75-1569803e15cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.149398 Jun 24 08:22:40.407194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 298/601] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:40 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:40.855504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:40.855504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:40.855504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:40.855504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.856480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:40.856480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:40.984229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:40.991696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-44f19ac8-2976-4bea-aa9d-9f05eaa3b174 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.152728 Jun 24 08:22:40.992274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 304/602] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:40 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:41.098866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:41.099589 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:41.106223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.106606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.107353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.107809 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.233381 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:41.240857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0e62da7e-ca70-4e37-a543-a0521d637812 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1508 microversion: 2.1 time: 0.145812 Jun 24 08:22:41.241648 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 299/603] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:41 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:41.257388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef7b1827-9b33-45c6-a0c9-2e80190b3ed6", "device": "/dev/sdb"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:41.258510 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:41.264014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:41.264658 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.264780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:41.265108 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.265867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.266303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.270644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.271089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.271849 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.272313 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.408370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:41.415824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3c03e4bb-0d1e-4813-a555-a2a894b261b4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.155638 Jun 24 08:22:41.416419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 300/604] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:41 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:41.422955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:41.423554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:41.429147 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.429589 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.430338 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:41.430765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:41.555564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:41.564847 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-267a0938-cdde-4bb3-b7c2-64671bfd4c4d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.145429 Jun 24 08:22:41.565406 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 301/605] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:41 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:42.009060 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:42.009676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:42.016608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:42.017054 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:42.017812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:42.018242 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:42.144464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:42.152446 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-275b4f92-4116-427f-8ac2-299ef8ef2463 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1366 microversion: 2.1 time: 0.146583 Jun 24 08:22:42.153067 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 302/606] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:42 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:42.433981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:42.434578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:42.440504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:42.440942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:42.441685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:42.442108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:42.576254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:42.588286 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4574dc96-6b18-4864-9ff4-804b7e967a2a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1675 microversion: 2.1 time: 0.158345 Jun 24 08:22:42.588871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 303/607] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:42 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:42.598031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:42.598637 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:42.604576 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:42.605066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:42.605832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:42.606264 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:42.734017 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:42.742011 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f1c91fee-9913-4ac6-ac83-7aa67b5f2972 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1735 microversion: 2.1 time: 0.147742 Jun 24 08:22:42.742577 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 304/608] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:42 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:43.125207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cbab368d-8fe8-473c-a7c2-63dd7e21acc0 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "POST /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.871569 Jun 24 08:22:43.125907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 305/609] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:22:41 2022] POST /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34/os-volume_attachments => generated 194 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:22:43.170315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:43.170927 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:43.177526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.178115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.178931 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.179530 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.314895 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:43.322454 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-deaabd60-e7fc-46cb-b725-4171d28741c5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1556 microversion: 2.1 time: 0.157224 Jun 24 08:22:43.323016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 305/610] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:43 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:43.338983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:43.339620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:43.346818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.347262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.348188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.348638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.428539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dc7258ad-1a71-4b63-a8e2-cdb8f074eed1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093776 Jun 24 08:22:43.429127 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 306/611] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:22:43 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:43.606743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:43.607399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:43.613307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.613743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.614487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.614909 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.760266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:43.760874 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:43.767814 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.768337 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:43.769105 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:43.769537 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.183759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:44.191684 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6a7e38cd-7512-4f31-b6b4-5f9541005484 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1652 microversion: 2.1 time: 0.589405 Jun 24 08:22:44.192263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 306/612] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:43 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1652 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:44.204679 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:44.209513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dab2a3bc-dfbf-4f7a-bafb-40af09961461 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1715 microversion: 2.1 time: 0.453610 Jun 24 08:22:44.210183 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 307/613] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:43 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1715 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:44.216585 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8ece2428-a42a-46b4-8e87-8270d581e6aa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:44.222685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8ece2428-a42a-46b4-8e87-8270d581e6aa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.223131 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8ece2428-a42a-46b4-8e87-8270d581e6aa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.250223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8ece2428-a42a-46b4-8e87-8270d581e6aa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Going to try to start instance {{(pid=118295) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 08:22:44.272312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:44.273057 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:44.279307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.280222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.280982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.281406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.362694 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] HTTP exception thrown: Cannot 'detach_volume' instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 while it is in vm_state rescued Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Request method failure captured: Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments/aa756d79-8e9a-45fd-a626-e1157882dfe3 HTTP/1.1 Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZBwTmdq5yAzMMjF96X7yeJ3d8jP1znACExJ4UN2fZLT3CsTKbSXox-XyNtrUxZ57VcL_BBgmhIYr5PzBAiI2iBNP8gjGURsnmqAb6w_gkRFw5xKpLgJhQclVWQs5Yf5UzOEvgX6-fqxq6v_iNcYqeyfWat8p4cr7Zm-UjUuCbS1o Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:22:44.364440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e79436f86e1e4038a7b0e41cf468bb62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}] Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 5ebbd67cca66411ea52e4b92478564cf Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:22:44.366140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Cannot 'detach_volume' instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 while it is in vm_state rescued Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'server_id': '4a24c2d2-6c59-4080-8eb6-4f0431fd54d4', 'id': 'aa756d79-8e9a-45fd-a626-e1157882dfe3'} Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:22:44.367117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 while it is in vm_state rescued Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 while it is in vm_state rescued Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:22:44.368713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Returning 409 to user: Cannot 'detach_volume' instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 while it is in vm_state rescued {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:22:44.370025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f48e8836-d99e-4a40-a936-7d76980d083e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments/aa756d79-8e9a-45fd-a626-e1157882dfe3" status: 409 len: 152 microversion: 2.1 time: 0.097615 Jun 24 08:22:44.370025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 308/614] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:22:44 2022] DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments/aa756d79-8e9a-45fd-a626-e1157882dfe3 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:22:44.375428 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:44.382438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:44.382720 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.383152 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.383893 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.384352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.466893 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8ece2428-a42a-46b4-8e87-8270d581e6aa tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action" status: 202 len: 0 microversion: 2.1 time: 0.255377 Jun 24 08:22:44.467437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 307/615] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:22:44 2022] POST /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:22:44.476291 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:44.476991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:44.484123 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.484614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.485394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.485834 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.624183 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6fc6b6ba-5903-49fb-a8c2-d68ad589b414 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "POST /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/action" status: 202 len: 0 microversion: 2.1 time: 0.253009 Jun 24 08:22:44.628798 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 309/616] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:22:44 2022] POST /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:22:44.634990 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:44.636001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:44.644234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.645051 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.646074 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:44.646689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:44.687757 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:44.698755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-83534cce-8430-4f35-a635-621c31395d65 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1661 microversion: 2.1 time: 0.226562 Jun 24 08:22:44.699213 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 308/617] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:44 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1661 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:44.865500 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:44.874694 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-97c73835-7d2d-4be5-98dd-c3eea36b2280 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1723 microversion: 2.1 time: 0.244202 Jun 24 08:22:44.875601 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 310/618] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:44 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:45.031754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-80d61a29-23a9-4b6c-9f66-e57ff89851b9 req-2ee32d43-ff46-470f-9953-adfadfb88e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb69e2f-11a1-4083-9b37-e10f77cc3ce0", "tag": "83d7f299-eea9-449a-ab6f-539ebb3654ea"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:45.040519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-80d61a29-23a9-4b6c-9f66-e57ff89851b9 req-2ee32d43-ff46-470f-9953-adfadfb88e3b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:45.041281 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-80d61a29-23a9-4b6c-9f66-e57ff89851b9 req-2ee32d43-ff46-470f-9953-adfadfb88e3b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:45.052494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-80d61a29-23a9-4b6c-9f66-e57ff89851b9 req-2ee32d43-ff46-470f-9953-adfadfb88e3b service nova] Creating event network-changed:83d7f299-eea9-449a-ab6f-539ebb3654ea for instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 on hv-cinder-83482 Jun 24 08:22:45.058655 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-80d61a29-23a9-4b6c-9f66-e57ff89851b9 req-2ee32d43-ff46-470f-9953-adfadfb88e3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029668 Jun 24 08:22:45.059804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 309/619] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:45.716083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:45.717083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:45.723167 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:45.723838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:45.724641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:45.725075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:45.871524 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:45.880227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-57276637-8315-4144-a65f-6d9cd10025e0 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1661 microversion: 2.1 time: 0.168047 Jun 24 08:22:45.897096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:45.897791 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:45.900066 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:45.902232 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 311/620] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:45 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1661 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:45.906366 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:45.906891 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:45.907781 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:45.908337 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:46.055453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:46.065068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-16f01543-1d47-484f-b185-dbddb538502e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1723 microversion: 2.1 time: 0.172077 Jun 24 08:22:46.065577 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 310/621] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:45 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:46.634814 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:46.635303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:46.642280 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:46.642727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:46.643478 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:46.643981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:46.671802 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ae38bf47-5592-473c-bb91-74dd7da05593 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments/ea0effb3-64c4-4864-93c4-8f5ccd37e3ec" status: 200 len: 194 microversion: 2.20 time: 0.041072 Jun 24 08:22:46.672392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 312/622] 10.222.0.42 () {60 vars in 1453 bytes} [Fri Jun 24 08:22:46 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments/ea0effb3-64c4-4864-93c4-8f5ccd37e3ec => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:46.739132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:46.739642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:46.746107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:46.746554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:46.747303 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:46.747728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:46.825703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lazy-loading 'services' on Instance uuid e2ac85cf-1104-4227-867c-51b136c5de24 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:22:46.898604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:46.899274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:46.906081 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:46.906523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:46.910224 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:46.910224 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:47.029957 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5a1716d3-7e41-411d-87ad-a01261067354 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments/ea0effb3-64c4-4864-93c4-8f5ccd37e3ec" status: 202 len: 0 microversion: 2.20 time: 0.294538 Jun 24 08:22:47.030825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 311/623] 10.222.0.42 () {60 vars in 1456 bytes} [Fri Jun 24 08:22:46 2022] DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments/ea0effb3-64c4-4864-93c4-8f5ccd37e3ec => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:22:47.039453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:47.042828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:47.043012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:47.047690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:47.048114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:47.048905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:47.049327 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:47.050037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-506cc124-7b42-4ef5-b4d5-91ffbbe714ce tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1665 microversion: 2.1 time: 0.155284 Jun 24 08:22:47.050605 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 313/624] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:46 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:47.082421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:47.082665 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6a8042b9-83b6-4204-a833-3459c60f9cd4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047483 Jun 24 08:22:47.083356 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 312/625] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:47 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:22:47.083477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:47.089418 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:47.089868 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:47.090644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:47.091055 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:47.222808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:47.231311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-979367a7-ee73-46c0-bfb3-231a113898aa tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1723 microversion: 2.1 time: 0.152858 Jun 24 08:22:47.231872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 314/626] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:47 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:22:48.095588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:48.096530 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:48.102953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:48.103394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:48.104173 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:48.104694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:48.133913 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d00ec528-b3ab-4956-bf44-98579f6cb755 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042534 Jun 24 08:22:48.134460 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 313/627] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:48 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:48.248869 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:48.249513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:48.256063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:48.256553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:48.257309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:48.257740 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:48.392234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:48.394536 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:48.400905 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f81e9bc5-f922-4a36-92aa-82946543a346 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1723 microversion: 2.1 time: 0.156597 Jun 24 08:22:48.401491 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 315/628] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:48 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:49.145909 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:49.146724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:49.152648 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:49.153084 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:49.153853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:49.154278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:49.157834 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:49.182081 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-52197087-3429-4a98-b8db-3494392ea38c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040275 Jun 24 08:22:49.182644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 314/629] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:49 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:49.419512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:49.420075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:49.427155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:49.427604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:49.428392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:49.428823 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:49.558942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:49.566877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-137a92bb-e268-42a2-b543-b063e2c2ca8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1729 microversion: 2.1 time: 0.152159 Jun 24 08:22:49.567438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 316/630] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:22:49 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:49.586329 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:49.586818 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:49.594039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:49.594477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:49.595282 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:49.595721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:49.672037 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a12018c6-b742-4099-a471-520f834f8103 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091655 Jun 24 08:22:49.672690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 315/631] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:22:49 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:50.194124 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:50.195090 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:50.201930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:50.202369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:50.203106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:50.203537 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:50.232731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-55c00cf1-2f73-477c-99d3-45f82d2cab42 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042656 Jun 24 08:22:50.233304 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 317/632] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:50 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:50.602858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-52ba3277-126c-47b2-977f-5baea41cad4d req-9113f6ef-9a3a-4662-8b9b-49e3482a774c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a24c2d2-6c59-4080-8eb6-4f0431fd54d4", "tag": "3ff5827b-387d-47d9-aadc-66a7f6553c95"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:50.611979 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-52ba3277-126c-47b2-977f-5baea41cad4d req-9113f6ef-9a3a-4662-8b9b-49e3482a774c service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:50.612459 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-52ba3277-126c-47b2-977f-5baea41cad4d req-9113f6ef-9a3a-4662-8b9b-49e3482a774c service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:50.624461 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-52ba3277-126c-47b2-977f-5baea41cad4d req-9113f6ef-9a3a-4662-8b9b-49e3482a774c service nova] Creating event network-changed:3ff5827b-387d-47d9-aadc-66a7f6553c95 for instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 on hv-cinder-83482 Jun 24 08:22:50.629962 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-52ba3277-126c-47b2-977f-5baea41cad4d req-9113f6ef-9a3a-4662-8b9b-49e3482a774c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030864 Jun 24 08:22:50.630560 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 316/633] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:51.245289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:51.246294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:51.252988 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:51.253437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:51.254198 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:51.254819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:51.288271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-80c0db50-6065-4f55-ae75-b9e47965e3e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046657 Jun 24 08:22:51.289327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 318/634] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:51 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:22:52.300946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:52.302016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:52.308493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:52.308924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:52.309679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:52.310107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:52.338672 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-64cd5bc9-845e-4438-954d-f0711b2dd0b0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042356 Jun 24 08:22:52.339221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 317/635] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:52 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:52.643721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-7e507566-e089-46fa-8e15-e1088fd7d7d1 req-64dccb55-c7e0-4993-92d9-125698e4992b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a24c2d2-6c59-4080-8eb6-4f0431fd54d4", "tag": "3ff5827b-387d-47d9-aadc-66a7f6553c95"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:22:52.652182 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7e507566-e089-46fa-8e15-e1088fd7d7d1 req-64dccb55-c7e0-4993-92d9-125698e4992b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:52.652647 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7e507566-e089-46fa-8e15-e1088fd7d7d1 req-64dccb55-c7e0-4993-92d9-125698e4992b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:52.664426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-7e507566-e089-46fa-8e15-e1088fd7d7d1 req-64dccb55-c7e0-4993-92d9-125698e4992b service nova] Creating event network-changed:3ff5827b-387d-47d9-aadc-66a7f6553c95 for instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 on hv-cinder-83482 Jun 24 08:22:52.670756 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-7e507566-e089-46fa-8e15-e1088fd7d7d1 req-64dccb55-c7e0-4993-92d9-125698e4992b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029520 Jun 24 08:22:52.671330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 319/636] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:22:53.350655 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:53.351570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:53.358290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:53.358733 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:53.359489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:53.359915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:53.388850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3fc16a0a-270e-48d7-b088-b0a579148529 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042187 Jun 24 08:22:53.389389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 318/637] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:53 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:54.401221 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:54.402220 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:54.409774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:54.410215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:54.410960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:54.411384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:54.439815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9d3361d3-0d38-4da6-8277-b40f7e0748d1 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043113 Jun 24 08:22:54.440308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 320/638] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:54 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:55.451165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:55.452018 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:55.458006 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:55.458442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:55.459187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:55.459608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:55.488605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7fb8a52b-f43c-49ef-abce-42b9c1004b15 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041550 Jun 24 08:22:55.489143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 319/639] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:55 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:22:56.499935 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:56.500945 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:56.507598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:56.508046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:56.508831 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:56.509264 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:56.538294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-97faaf0a-c541-49b2-b245-4603546ac28b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042324 Jun 24 08:22:56.538756 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 321/640] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:22:56 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:22:56.605680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:56.606324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:56.612363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:56.612810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:56.613594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:56.614050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:56.638337 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:22:56.976842 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d74096b8-1dee-4542-99ae-9f6051c3cb9b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 204 len: 0 microversion: 2.20 time: 0.374633 Jun 24 08:22:56.977437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 320/641] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 24 08:22:56 2022] DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:22:56.986455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:56.987058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:56.993095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:56.993534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:56.994273 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:56.994702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:57.128703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:57.136648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:57.138081 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:57.139300 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f206695f-1370-41ef-a5a8-bfc893bf306f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.156705 Jun 24 08:22:57.139850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 322/642] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:56 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:22:58.158908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:58.159512 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:58.165439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:58.165875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:58.166616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:58.167036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:58.299592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:58.307571 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:58.309349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:58.310494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1aeee910-ebb7-498f-9a3d-5711ab5c9356 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.156338 Jun 24 08:22:58.311047 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 321/643] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:58 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:22:59.328139 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:22:59.328761 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:22:59.336087 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:59.336558 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:59.337328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:22:59.337752 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:22:59.465671 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:59.473623 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:59.475103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:22:59.476252 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-91478d24-514b-4257-817b-ad49775341c9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.151989 Jun 24 08:22:59.476807 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 323/644] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:22:59 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:00.494968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:00.495548 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:00.501617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:00.502055 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:00.502858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:00.503289 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:00.633563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:00.641345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:00.642847 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:00.644169 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bff9c865-6185-4273-bdf6-959c072e3ba2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.153112 Jun 24 08:23:00.644748 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 322/645] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:00 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:01.662548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:01.663160 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:01.669625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:01.670073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:01.670822 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:01.671255 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:01.798840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:01.807966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:01.809717 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:01.810851 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8e0d5c6d-bafa-4418-8f2e-e166b1866b6b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1724 microversion: 2.20 time: 0.152222 Jun 24 08:23:01.811400 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 324/646] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:01 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:02.829934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:02.830544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:02.837617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:02.838289 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:02.839060 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:02.839486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:02.889691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-77e052a9-4f5a-408d-b4a1-18b9eba3d2d3 req-f56092cf-f0e4-4b18-928f-7ff8b2dea9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac85cf-1104-4227-867c-51b136c5de24", "name": "network-vif-deleted", "tag": "97d9a70f-da10-48c1-8fe9-7faf5a9301af"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:02.906401 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-77e052a9-4f5a-408d-b4a1-18b9eba3d2d3 req-f56092cf-f0e4-4b18-928f-7ff8b2dea9e6 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:02.912328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-77e052a9-4f5a-408d-b4a1-18b9eba3d2d3 req-f56092cf-f0e4-4b18-928f-7ff8b2dea9e6 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:02.926241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:02.930600 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-77e052a9-4f5a-408d-b4a1-18b9eba3d2d3 req-f56092cf-f0e4-4b18-928f-7ff8b2dea9e6 service nova] Creating event network-vif-deleted:97d9a70f-da10-48c1-8fe9-7faf5a9301af for instance e2ac85cf-1104-4227-867c-51b136c5de24 on hv-cinder-83482 Jun 24 08:23:02.935975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:02.943995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-77e052a9-4f5a-408d-b4a1-18b9eba3d2d3 req-f56092cf-f0e4-4b18-928f-7ff8b2dea9e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050015 Jun 24 08:23:02.943995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 325/647] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:23:02.944587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:02.944587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a467bc6d-e1d2-40a9-88f2-d3cd2467d810 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1656 microversion: 2.20 time: 0.113140 Jun 24 08:23:02.944587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 323/648] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:02 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1656 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:03.959244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:03.960070 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:03.966365 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:03.966816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:03.967579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:03.968018 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:04.003002 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:04.003552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:04.003953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lazy-loading 'fault' on Instance uuid e2ac85cf-1104-4227-867c-51b136c5de24 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:04.051595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:04.059443 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:04.060917 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:04.062064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-04e651fe-473c-40d0-902f-acf9a1d37258 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 200 len: 1372 microversion: 2.20 time: 0.108478 Jun 24 08:23:04.062619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 326/649] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:03 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:04.256135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:04.256678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:04.262610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:04.263052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:04.263795 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:04.264245 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:04.342581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lazy-loading 'services' on Instance uuid db7d9be6-b120-49bf-bf5a-6abf47f52e34 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:04.508247 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f6264e2c-62b5-40d7-8718-81f8aa8345da tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34/os-volume_attachments/ef7b1827-9b33-45c6-a0c9-2e80190b3ed6" status: 202 len: 0 microversion: 2.1 time: 0.256284 Jun 24 08:23:04.508940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 324/650] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:23:04 2022] DELETE /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34/os-volume_attachments/ef7b1827-9b33-45c6-a0c9-2e80190b3ed6 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:23:05.079724 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:05.080415 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:05.087132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:05.087575 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:05.088349 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:05.088822 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:05.102635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] HTTP exception thrown: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Request method failure captured: Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 HTTP/1.1 Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZnsXslTag3NdYB_EZcwOfaXs-vCzL4DXG04jgroXcB0gAVB8gpaEx4uDDczXonENOi4JVx66U9r2NjbXRm57W9v0ZBoqba-T3IeGYCM-FNfSoVQ10lpPAcHCqpwkhzXH9l9aEuWzAYinPQahxqeOlbi7tHC0lRkUNxQvNMvIWSig Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:23:05.104242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1244423396f45beb9124e6d04e0381b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}] Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 6935dece64c14ab28be74275d43f07ab Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:23:05.105973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'e2ac85cf-1104-4227-867c-51b136c5de24'} Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:05.107723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:23:05.109299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:05.110622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Returning 404 to user: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:05.110622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b4a0cbad-ec9b-4db7-a325-81a70ceb75c0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 404 len: 111 microversion: 2.20 time: 0.029932 Jun 24 08:23:05.110622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 327/651] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:05 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:23:05.115489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e4e948e9-82f1-4a01-95ac-1994dc5e1e65 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '.version_select at 0x7f14962e7430>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:05.195661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e4e948e9-82f1-4a01-95ac-1994dc5e1e65 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306386710" status: 204 len: 0 microversion: 2.20 time: 0.084878 Jun 24 08:23:05.196270 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 325/652] 10.222.0.42 () {60 vars in 1261 bytes} [Fri Jun 24 08:23:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306386710 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:23:05.979653 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e9aa6858-c2f8-4af5-ba06-75def35ea69d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'create', calling method: .version_select at 0x7f1496138d30>, body: {"keypair": {"name": "tempest-keypair-104440579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxnfbpGWLhtTq5I8DkRroxUxWPir+o6nBmBZz0cXdtOmyPJBngZTN6QawPVPPJcY5Mh7/nsxOiAF0arQWSa1wESWKxe887W8LORWwi8Nk6OH2aT91e03vHJMEdqWIoBYA=="}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:05.993278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-e9aa6858-c2f8-4af5-ba06-75def35ea69d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for project e1244423396f45beb9124e6d04e0381b. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:23:05.997007 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-e9aa6858-c2f8-4af5-ba06-75def35ea69d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for user 6935dece64c14ab28be74275d43f07ab and project e1244423396f45beb9124e6d04e0381b. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:23:06.116831 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e9aa6858-c2f8-4af5-ba06-75def35ea69d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.141077 Jun 24 08:23:06.117511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 328/653] 10.222.0.42 () {62 vars in 1199 bytes} [Fri Jun 24 08:23:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 08:23:06.679068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:06.679701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:06.686225 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:06.686621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:06.687379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:06.687812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:06.714487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:06.943522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-49ff3182-12f1-4735-805e-e759202a8a94 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 204 len: 0 microversion: 2.1 time: 0.268948 Jun 24 08:23:06.944111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 326/654] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:06 2022] DELETE /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:23:06.952211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:06.952817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:06.954810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:06.961063 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:06.961509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:06.962263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:06.962782 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:07.321075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:07.328952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-caf2110e-a33a-481e-939c-0feb3fd9d7f2 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1514 microversion: 2.1 time: 0.380564 Jun 24 08:23:07.329508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 329/655] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:06 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1514 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:08.347540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:08.348253 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:08.354425 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:08.354865 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:08.355616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:08.356036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:08.488465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:08.496032 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-64dfb039-deed-42a1-94e9-1daa18eeb00d tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1514 microversion: 2.1 time: 0.152935 Jun 24 08:23:08.496712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 327/656] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:08 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:08.675078 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2147333825", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c50a71f-1e65-4e5e-ae0f-e6f8fa025675"}], "security_groups": [{"name": "tempest-securitygroup--238651079"}], "key_name": "tempest-keypair-104440579", "user_data": "}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:08.775994 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] validate_networks() for [('4c50a71f-1e65-4e5e-ae0f-e6f8fa025675', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:23:09.141736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:23:09.142156 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:23:09.142625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:23:09.143028 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:23:09.143436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:23:09.152900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:09.153345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:09.154129 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:09.154586 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:09.171438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for project e1244423396f45beb9124e6d04e0381b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:23:09.175416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Getting quotas for user 6935dece64c14ab28be74275d43f07ab and project e1244423396f45beb9124e6d04e0381b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:23:09.186975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:23:09.189386 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:23:09.335268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-302130ce-7aa7-48b3-aca3-ad77663aa342 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.664972 Jun 24 08:23:09.336104 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 330/657] 10.222.0.42 () {62 vars in 1187 bytes} [Fri Jun 24 08:23:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:23:09.354359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-19b8c26f-86be-4f2b-8987-4df66b62d024 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:09.354944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-19b8c26f-86be-4f2b-8987-4df66b62d024 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:09.423895 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-19b8c26f-86be-4f2b-8987-4df66b62d024 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:09.431493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-19b8c26f-86be-4f2b-8987-4df66b62d024 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:09.433313 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-19b8c26f-86be-4f2b-8987-4df66b62d024 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:09.434427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-19b8c26f-86be-4f2b-8987-4df66b62d024 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1281 microversion: 2.20 time: 0.084940 Jun 24 08:23:09.435186 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 328/658] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:09 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:09.514463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:09.515071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:09.524169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:09.524639 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:09.525402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:09.525907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:09.624628 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:09.638315 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-080cdb7a-caa9-4e0d-9a2e-242ae73a1e83 tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1472 microversion: 2.1 time: 0.124429 Jun 24 08:23:09.638315 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 331/659] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:09 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1472 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:09.647788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-82a18d55-d851-4ca3-9f4f-cdf5943dd409 req-b0dd4780-765d-4885-be0c-db21c43f3a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7d9be6-b120-49bf-bf5a-6abf47f52e34", "name": "network-vif-deleted", "tag": "ebb1f926-526f-4167-bc22-2fae3e150bd4"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:09.656855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-82a18d55-d851-4ca3-9f4f-cdf5943dd409 req-b0dd4780-765d-4885-be0c-db21c43f3a0f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:09.657441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-82a18d55-d851-4ca3-9f4f-cdf5943dd409 req-b0dd4780-765d-4885-be0c-db21c43f3a0f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:09.668669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-82a18d55-d851-4ca3-9f4f-cdf5943dd409 req-b0dd4780-765d-4885-be0c-db21c43f3a0f service nova] Creating event network-vif-deleted:ebb1f926-526f-4167-bc22-2fae3e150bd4 for instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 on hv-cinder-83482 Jun 24 08:23:09.673586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-82a18d55-d851-4ca3-9f4f-cdf5943dd409 req-b0dd4780-765d-4885-be0c-db21c43f3a0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030839 Jun 24 08:23:09.674555 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 329/660] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:23:10.455811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:10.456592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:10.463371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:10.463820 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:10.464642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:10.465187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:10.528134 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:10.539410 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:10.540957 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:10.542096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a977e965-2091-492d-8136-b899e69991ef tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1285 microversion: 2.20 time: 0.090373 Jun 24 08:23:10.542664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 332/661] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:10 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:10.653826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:10.654529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:10.661705 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:10.662152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:10.662923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:10.663356 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:10.682116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:10.695348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:10.695793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:10.696259 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lazy-loading 'fault' on Instance uuid db7d9be6-b120-49bf-bf5a-6abf47f52e34 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:10.739061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69533891e4cf463bb3fe9ac5cf7f4215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae6efd4ad46479cb965caa8a97a772a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:10.745699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b8250b1c-c550-4682-a86d-3e4e8f4d82bd tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 200 len: 1309 microversion: 2.1 time: 0.096126 Jun 24 08:23:10.746332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 330/662] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:10 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:11.561153 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:11.561751 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:11.578372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:11.578372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:11.578372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:11.578372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:11.643547 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:11.652057 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:11.653751 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:11.654829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ac7ae606-5acb-446f-bb77-51c615a5e4a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1341 microversion: 2.20 time: 0.098066 Jun 24 08:23:11.660426 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 333/663] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:11 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:11.763301 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:11.763916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] [instance: db7d9be6-b120-49bf-bf5a-6abf47f52e34] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:11.770772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:11.775159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:11.775159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:11.775159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:11.787870 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] HTTP exception thrown: Instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 could not be found. Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Request method failure captured: Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 HTTP/1.1 Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXPekXG3rg9XRHhtUWIGHyp1Bew17WIZG5c306EEQT_XXQq7wETV4SlrT4RCtHgh4q-N6tL2D86yCAachTmzhEz4JVjNBkVrvHe0js6H0nB3h-mdyjxKla7ifLuenb_3D0-Lrb5tLN2XfuSoD9MkI5EuhR5jKmZjbe66mrmq6UfbMDs Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: dae6efd4ad46479cb965caa8a97a772a Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesSnapshotTestJSON-338857145 Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:23:11.789556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dae6efd4ad46479cb965caa8a97a772a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dae6efd4ad46479cb965caa8a97a772a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dae6efd4ad46479cb965caa8a97a772a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dae6efd4ad46479cb965caa8a97a772a"}]}] Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesSnapshotTestJSON-338857145 Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: dae6efd4ad46479cb965caa8a97a772a Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-338857145 Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesSnapshotTestJSON-338857145-project Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 69533891e4cf463bb3fe9ac5cf7f4215 Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesSnapshotTestJSON-338857145-project Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 could not be found. Jun 24 08:23:11.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'db7d9be6-b120-49bf-bf5a-6abf47f52e34'} Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 could not be found. Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:11.791994 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 could not be found. Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 could not be found. Jun 24 08:23:11.793227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:11.794274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] Returning 404 to user: Instance db7d9be6-b120-49bf-bf5a-6abf47f52e34 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:11.794274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-10e11bbf-fffe-4ab5-8448-d69444207a9c tempest-VolumesSnapshotTestJSON-338857145 tempest-VolumesSnapshotTestJSON-338857145-project] 10.222.0.42 "GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34" status: 404 len: 111 microversion: 2.1 time: 0.031885 Jun 24 08:23:11.794274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 331/664] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:11 2022] GET /compute/v2.1/servers/db7d9be6-b120-49bf-bf5a-6abf47f52e34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:23:12.674582 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:12.675140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:12.681652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:12.682097 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:12.682853 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:12.683536 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:12.815844 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:12.824673 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:12.826191 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:12.827271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a3745352-a6d9-4e94-8cf4-b946b36c54fc tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.156796 Jun 24 08:23:12.827819 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 334/665] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:12 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:13.290131 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-b763662b-9473-4524-bef2-4cb802d2e13b req-eab18133-1397-4302-b082-09d25d0ef20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:13.299607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-b763662b-9473-4524-bef2-4cb802d2e13b req-eab18133-1397-4302-b082-09d25d0ef20a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:13.299941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-b763662b-9473-4524-bef2-4cb802d2e13b req-eab18133-1397-4302-b082-09d25d0ef20a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:13.320005 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-b763662b-9473-4524-bef2-4cb802d2e13b req-eab18133-1397-4302-b082-09d25d0ef20a service nova] Creating event network-changed:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:23:13.325104 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-b763662b-9473-4524-bef2-4cb802d2e13b req-eab18133-1397-4302-b082-09d25d0ef20a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040857 Jun 24 08:23:13.325708 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 332/666] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:13.864678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:13.865342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:13.874173 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:13.874537 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:13.875294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:13.875718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:14.015379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:14.017812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:14.024942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:14.026453 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:14.027541 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2a9229b4-8eaf-4d27-9c30-658205d288ea tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.184907 Jun 24 08:23:14.028101 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 335/667] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:13 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:15.045904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:15.046588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:15.053348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:15.053790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:15.054541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:15.054966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:15.185814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:15.194022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:15.195520 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:15.196641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d7386fa0-617e-46c9-ac26-d7e52a95ce99 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.154910 Jun 24 08:23:15.197202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 333/668] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:15 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:16.214891 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:16.215414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:16.221612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:16.222059 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:16.222814 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:16.223242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:16.349475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:16.357348 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:16.358844 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:16.359930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c5368325-dfcb-46f5-b78c-4b484e990bb2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.149405 Jun 24 08:23:16.360527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 336/669] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:16 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:17.378238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:17.378833 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:17.381499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:17.386190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:17.386626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:17.387375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:17.387798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:17.572060 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:17.579956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:17.581490 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:17.582921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6fdb6207-81e1-4fef-9ecf-50e7de14a447 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.208252 Jun 24 08:23:17.583150 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 334/670] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:17 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:18.601008 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:18.601624 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:18.608092 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:18.608580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:18.609334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:18.609754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:18.741921 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:18.749923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:18.751477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:18.752609 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fb5f3921-f4ab-4f89-a5e2-b4a86a5e6006 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.155583 Jun 24 08:23:18.753157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 337/671] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:18 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:19.771802 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:19.772578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:19.774463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:19.779164 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:19.779610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:19.780468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:19.780898 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:19.914294 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:19.921977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:19.923510 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:19.924617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ce12fa3c-ac86-4eee-9ace-7039631b4091 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.157281 Jun 24 08:23:19.925175 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 335/672] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:19 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:20.942848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:20.943454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:20.945538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:20.946206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=10 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:20.951468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:20.954525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:20.954525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:20.954525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:21.092021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:21.100704 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:21.102202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:21.103298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c91e1b44-6697-4cd7-8c1e-fff2d2433ca5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.164503 Jun 24 08:23:21.103853 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 338/673] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:20 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:22.121737 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:22.122335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:22.128279 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:22.128724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:22.129463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:22.129886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:22.257857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:22.265751 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:22.267240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:22.268350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-16252e93-cb95-4b46-b0cd-29e6c8a09e5d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.150491 Jun 24 08:23:22.268907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 336/674] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:22 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:23.240332 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-22a05d78-25ef-433f-9863-2ed0e092c236 req-2e679532-302f-4bea-90ad-78a3b7f66d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "name": "network-vif-plugged", "status": "completed", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:23.250259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-22a05d78-25ef-433f-9863-2ed0e092c236 req-2e679532-302f-4bea-90ad-78a3b7f66d51 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:23.250696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-22a05d78-25ef-433f-9863-2ed0e092c236 req-2e679532-302f-4bea-90ad-78a3b7f66d51 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:23.262060 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-22a05d78-25ef-433f-9863-2ed0e092c236 req-2e679532-302f-4bea-90ad-78a3b7f66d51 service nova] Creating event network-vif-plugged:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:23:23.267042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-22a05d78-25ef-433f-9863-2ed0e092c236 req-2e679532-302f-4bea-90ad-78a3b7f66d51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Jun 24 08:23:23.267610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 339/675] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:23.285793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:23.286394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:23.292494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:23.292938 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:23.293685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:23.294136 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:23.427836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:23.436111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:23.437748 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:23.438841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ca588f75-9969-4010-8ed0-137a670f5e06 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.156890 Jun 24 08:23:23.439412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 337/676] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:23 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:24.458083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:24.458712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:24.464913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:24.465524 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:24.466269 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:24.466691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:24.642848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:24.650927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:24.652476 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:24.653571 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c1604f8e-4583-4524-8eea-9fbe333aa8c4 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.200205 Jun 24 08:23:24.654127 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 340/677] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:24 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:25.671097 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:25.671699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:25.677656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:25.678099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:25.679476 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:25.679908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:25.809993 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:25.817811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:25.819799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:25.820913 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-694ee00f-84b0-4af0-a3ce-cde5acd0c05d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.153766 Jun 24 08:23:25.821470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 338/678] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:25 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:26.839746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:26.840383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:26.846849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:26.847290 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:26.848040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:26.848496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:26.976820 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:26.985076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:26.986603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:26.987698 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-46be4582-c393-4e5d-bf49-bd62e2d17aa7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.152546 Jun 24 08:23:26.988282 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 341/679] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:26 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:28.006498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:28.007142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:28.014612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:28.015135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:28.015938 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:28.016500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:28.145062 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:28.152928 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:28.154458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:28.155547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-89a09d76-6e96-4361-a035-51c4e7987f2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1406 microversion: 2.20 time: 0.153006 Jun 24 08:23:28.156099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 339/680] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:28 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:29.174448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:29.175040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:29.181311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:29.181809 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:29.182567 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:29.183253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:29.316754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:29.325393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:29.326945 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:29.328083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-27510dca-c546-40d7-94d2-db5db666872e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1597 microversion: 2.20 time: 0.157989 Jun 24 08:23:29.328791 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 342/681] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:23:29 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:23:29.345600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:29.346180 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:29.352155 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:29.352627 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:29.353384 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:29.353811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:29.430330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3552ec38-6a73-4f49-83ac-a27a0ecbe8a6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088584 Jun 24 08:23:29.430925 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 340/682] 10.222.0.42 () {60 vars in 1315 bytes} [Fri Jun 24 08:23:29 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:23:30.437991 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-a96baa38-de1c-42d3-a8b7-181812a34c47 req-68e68f81-65ac-4b41-88cf-de69678ee0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:30.447057 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-a96baa38-de1c-42d3-a8b7-181812a34c47 req-68e68f81-65ac-4b41-88cf-de69678ee0cc service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:30.447499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-a96baa38-de1c-42d3-a8b7-181812a34c47 req-68e68f81-65ac-4b41-88cf-de69678ee0cc service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:30.458595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-a96baa38-de1c-42d3-a8b7-181812a34c47 req-68e68f81-65ac-4b41-88cf-de69678ee0cc service nova] Creating event network-changed:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:23:30.463603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-a96baa38-de1c-42d3-a8b7-181812a34c47 req-68e68f81-65ac-4b41-88cf-de69678ee0cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029236 Jun 24 08:23:30.464308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 343/683] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:30.783109 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:23:30.783609 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:23:35.421038 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:35.421966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:35.427985 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:35.428465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:35.429221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:35.429652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:35.460379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-41e1b425-a5a0-4907-bb79-7a236971d3a8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043211 Jun 24 08:23:35.460969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 341/684] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:35 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 08:23:35.520764 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:35.521345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:35.528068 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:35.528527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:35.529394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:35.529867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:35.554597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:35.839654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-40f4544a-88d7-49d2-8075-26a7ab76516e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 204 len: 0 microversion: 2.1 time: 0.323334 Jun 24 08:23:35.840266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 344/685] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:35 2022] DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:23:35.848233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:35.848887 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:35.855012 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:35.860700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:35.860700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:35.860700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:35.982946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:35.990290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-770f184b-30e7-457a-a383-6cbe44e8152b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1671 microversion: 2.1 time: 0.145920 Jun 24 08:23:35.990869 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 342/686] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:35 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:36.174544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:36.181284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:36.182965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:36.183690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:36.184474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:36.184906 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:36.210564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-60fba897-0faa-42b7-bc67-d9ae20c6e550 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/ips" status: 200 len: 150 microversion: 2.1 time: 0.097254 Jun 24 08:23:36.215342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 345/687] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:23:36 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/ips => generated 150 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:37.007889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:37.008533 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:37.015359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:37.015803 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:37.016629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:37.017089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:37.147228 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:37.154804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5646bbaf-7c29-4c38-bc0d-53e478957e4e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1671 microversion: 2.1 time: 0.150747 Jun 24 08:23:37.155376 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 343/688] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:37 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:37.844690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf49f2d7-a56a-46e4-bb2c-957111d824fa"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:37.846030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:37.848974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:37.854469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:37.855072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:37.855921 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:37.856437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.053557 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:38.054085 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:38.060643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:38.063162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.063162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:38.063162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.152355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'services' on Instance uuid 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:38.434199 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c1ed44fd-3380-4a8a-8a69-704370db5ef2 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments/aa756d79-8e9a-45fd-a626-e1157882dfe3" status: 202 len: 0 microversion: 2.1 time: 0.384429 Jun 24 08:23:38.439744 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 344/689] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:23:38 2022] DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments/aa756d79-8e9a-45fd-a626-e1157882dfe3 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:23:38.443439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:38.444414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:38.451355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:38.452021 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.452846 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:38.453444 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.616581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:38.625800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b126961b-6cc2-4964-aef1-4b496705f3ee tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1671 microversion: 2.1 time: 0.189772 Jun 24 08:23:38.626470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 345/690] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:38 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:38.631936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:38.633102 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:38.639577 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:38.640020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.640811 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:38.641240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:38.671509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1bf627b9-308c-45be-9c13-383f83723639 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Jun 24 08:23:38.672276 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 346/691] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:38 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:38.935383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-01bd8c7a-d9d5-4035-bc89-5e752cdaf824 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.094573 Jun 24 08:23:38.940561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 346/692] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:23:37 2022] POST /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments => generated 194 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:39.398374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-99300a66-aa53-40e0-8aba-75f2f362127d req-88b3b9df-7ec0-430f-92b9-84fbe1721e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47798514-cc6d-44cd-bb83-cc051cd57531", "name": "network-vif-deleted", "tag": "e384c8cd-dcc0-44bf-befe-34c87737476f"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:39.406567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-99300a66-aa53-40e0-8aba-75f2f362127d req-88b3b9df-7ec0-430f-92b9-84fbe1721e34 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:39.407131 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-99300a66-aa53-40e0-8aba-75f2f362127d req-88b3b9df-7ec0-430f-92b9-84fbe1721e34 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:39.419480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-99300a66-aa53-40e0-8aba-75f2f362127d req-88b3b9df-7ec0-430f-92b9-84fbe1721e34 service nova] Creating event network-vif-deleted:e384c8cd-dcc0-44bf-befe-34c87737476f for instance 47798514-cc6d-44cd-bb83-cc051cd57531 on hv-cinder-83482 Jun 24 08:23:39.435922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-99300a66-aa53-40e0-8aba-75f2f362127d req-88b3b9df-7ec0-430f-92b9-84fbe1721e34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Jun 24 08:23:39.437024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 347/693] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:23:39.645685 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:39.646403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:39.662781 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:39.664983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:39.667625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:39.668065 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:39.684071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:39.685096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:39.693547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:39.694412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:39.695572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:39.696502 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:39.718625 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:39.738072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4ffb59bf-fe8f-4702-8fcd-5de7f4392ffd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058398 Jun 24 08:23:39.739211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 348/694] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:39 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:39.787179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:39.796324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-98a51906-e149-44a0-b763-5aa3bc85d346 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 200 len: 1322 microversion: 2.1 time: 0.156853 Jun 24 08:23:39.797504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 347/695] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:39 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:40.751089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:40.752081 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:40.759575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:40.760172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:40.760951 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:40.761375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:40.789615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0b6810cc-8e59-4df2-bfe9-1f9a864b75cd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042511 Jun 24 08:23:40.791232 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 349/696] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:40 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:23:40.821179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:40.821950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:40.828301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:40.828748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:40.829505 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:40.829936 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:40.843739 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] HTTP exception thrown: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Request method failure captured: Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 HTTP/1.1 Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNWjOAIkTccBJAacjTCAKNJlfNprknFzf5D-KAfL_x8WIM90dt1CSXvd3iuTmRXREdv3ggU43Rwl2iyzYEoS1mdEzr5yxLRleOMozFZ7Cp2p7YoP4i2H645IihkYiEDCe90NowVOUHRATrBfeaopw-zywrx0pU6ky2gwnSAwPUYajs Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:23:40.845716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc30155e50104560b2cd8d95f3e534a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}] Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: b3345cc7b11246358bb1f5babd054e60 Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:23:40.847227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '47798514-cc6d-44cd-bb83-cc051cd57531'} Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:40.848114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:23:40.849519 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:40.850809 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Returning 404 to user: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:40.850809 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bc18cdbc-d10e-45c2-aa69-9d3dbc504e0f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 404 len: 111 microversion: 2.1 time: 0.029786 Jun 24 08:23:40.851333 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 348/697] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:40 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:23:40.858809 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-68fb8c6a-42c1-4b6a-b45c-8c4861f32cae tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '.version_select at 0x7f1496204670>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:40.862911 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:40.862911 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:40.869112 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:40.869567 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:40.870339 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:40.870844 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:40.895816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:40.943106 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-68fb8c6a-42c1-4b6a-b45c-8c4861f32cae tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010666935" status: 202 len: 0 microversion: 2.1 time: 0.088634 Jun 24 08:23:40.943793 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 350/698] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 24 08:23:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010666935 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:23:41.279403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f34aaeb9-b8a1-4f5a-8521-661c21c2a91c tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 204 len: 0 microversion: 2.1 time: 0.421356 Jun 24 08:23:41.280142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 349/699] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:40 2022] DELETE /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:23:41.288181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:41.288813 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:41.295844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:41.296330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:41.297096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:41.297531 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:41.506393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:41.514112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b0fe308d-c706-442f-aadc-53fcffca66c6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1689 microversion: 2.1 time: 0.229877 Jun 24 08:23:41.514758 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 351/700] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:41 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:41.875678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e18cff52-3f42-4c30-a706-b8475655087d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: .version_select at 0x7f14960fd700>, body: {"keypair": {"name": "tempest-keypair-3355311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwacyo8xxyuaFdlsI3eellWVj+F+bF5TskAvlasOIjxu8hYNozA1N92wtgxdiCkqLIPg8cFrSJj/NkU2lvfARSBuR+Q8jA+VelkDeH540z576mFK3y25OnZp+hwB1SCyg=="}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:41.890226 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-e18cff52-3f42-4c30-a706-b8475655087d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for project dc30155e50104560b2cd8d95f3e534a6. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:23:41.893985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-e18cff52-3f42-4c30-a706-b8475655087d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for user b3345cc7b11246358bb1f5babd054e60 and project dc30155e50104560b2cd8d95f3e534a6. Resources: {'key_pairs'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:23:42.023490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e18cff52-3f42-4c30-a706-b8475655087d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.152045 Jun 24 08:23:42.024093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 350/701] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:23:41 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:42.530995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:42.531576 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:42.537568 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:42.538004 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:42.538744 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:42.539217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:42.685649 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:42.693492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f5b8a876-299a-44e1-9884-c2c12c353b00 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1689 microversion: 2.1 time: 0.166345 Jun 24 08:23:42.694082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 352/702] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:42 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:43.711048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:43.711934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:43.720305 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:43.720763 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:43.721537 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:43.721973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:43.724956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:43.887149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:43.895276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-639c31db-288e-4acd-8f20-58789671d7f8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1689 microversion: 2.1 time: 0.188115 Jun 24 08:23:43.895858 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 351/703] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:43 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:44.910238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1695507620", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c76a2a8e-3a64-4d93-aa9d-693f42506f96"}], "security_groups": [{"name": "tempest-securitygroup--655627599"}], "key_name": "tempest-keypair-3355311", "user_data": "}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:44.912178 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:44.912894 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:44.920528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:44.920973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:44.921958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:44.922177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:45.057328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] validate_networks() for [('c76a2a8e-3a64-4d93-aa9d-693f42506f96', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:23:45.110076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:45.118728 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-695ec47f-58a5-448e-a563-4d48c945edbf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1689 microversion: 2.1 time: 0.209845 Jun 24 08:23:45.119379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 352/704] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:44 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:45.541621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:23:45.542046 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:23:45.542517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:23:45.542922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:23:45.543331 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:23:45.551923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:45.552410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:45.553203 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:45.553631 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:45.571108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for project dc30155e50104560b2cd8d95f3e534a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:23:45.575487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Getting quotas for user b3345cc7b11246358bb1f5babd054e60 and project dc30155e50104560b2cd8d95f3e534a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:23:45.592536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:23:45.594800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:23:45.751405 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c4a33a1f-91a1-45d6-b47e-201cf72f336a tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.839823 Jun 24 08:23:45.751405 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 353/705] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:23:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:23:45.757481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f2e3840b-0696-46dd-832c-eb7911206c7d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:45.758090 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f2e3840b-0696-46dd-832c-eb7911206c7d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:45.819048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f2e3840b-0696-46dd-832c-eb7911206c7d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:45.825668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f2e3840b-0696-46dd-832c-eb7911206c7d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1235 microversion: 2.1 time: 0.072776 Jun 24 08:23:45.832082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 353/706] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:45 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:46.035028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-a1b1a29b-76d7-43eb-8f85-814067c6e49f req-7bf16d59-66a8-4eb2-a627-32cefccee49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a24c2d2-6c59-4080-8eb6-4f0431fd54d4", "name": "network-vif-deleted", "tag": "3ff5827b-387d-47d9-aadc-66a7f6553c95"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:46.046155 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-a1b1a29b-76d7-43eb-8f85-814067c6e49f req-7bf16d59-66a8-4eb2-a627-32cefccee49a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:46.046594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-a1b1a29b-76d7-43eb-8f85-814067c6e49f req-7bf16d59-66a8-4eb2-a627-32cefccee49a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:46.059242 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-a1b1a29b-76d7-43eb-8f85-814067c6e49f req-7bf16d59-66a8-4eb2-a627-32cefccee49a service nova] Creating event network-vif-deleted:3ff5827b-387d-47d9-aadc-66a7f6553c95 for instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 on hv-cinder-83482 Jun 24 08:23:46.067384 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-a1b1a29b-76d7-43eb-8f85-814067c6e49f req-7bf16d59-66a8-4eb2-a627-32cefccee49a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036598 Jun 24 08:23:46.068436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 354/707] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:46.140111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:46.141545 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:46.156627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:46.157262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:46.158346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:46.159071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:46.243000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:46.253788 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b7d954eb-20d4-463c-8452-1b7775a12591 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1622 microversion: 2.1 time: 0.121832 Jun 24 08:23:46.257442 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 354/708] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:46 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1622 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:46.843959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:46.844928 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:46.851831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:46.852308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:46.853240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:46.853743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:46.922778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:46.930352 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-33f55b56-a394-47b3-a76b-488f5e9a91de tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1239 microversion: 2.1 time: 0.090878 Jun 24 08:23:46.931197 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 355/709] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:46 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:47.270951 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:47.271625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.278359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.282561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.282561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.282561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.312838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.312838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.312838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'fault' on Instance uuid 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:47.332161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:47.335953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.354190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.355174 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.355412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.355843 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.380987 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:47.387805 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:47.389845 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-656ab61d-f6bd-485e-a7af-60aa2fca3125 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 200 len: 1335 microversion: 2.1 time: 0.122776 Jun 24 08:23:47.390679 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 355/710] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:47 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 1335 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:47.509900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf49f2d7-a56a-46e4-bb2c-957111d824fa"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:47.510986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.517030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.517480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.518241 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.518674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.605312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Invalid volume: volume bf49f2d7-a56a-46e4-bb2c-957111d824fa is already attached to instances: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: POST /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments HTTP/1.1 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 74 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:23:47.607265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {"volumeAttachment": {"volumeId": "bf49f2d7-a56a-46e4-bb2c-957111d824fa"}} Jun 24 08:23:47.608899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Invalid volume: volume bf49f2d7-a56a-46e4-bb2c-957111d824fa is already attached to instances: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'server_id': '2cb69e2f-11a1-4083-9b37-e10f77cc3ce0', 'body': {'volumeAttachment': {'volumeId': 'bf49f2d7-a56a-46e4-bb2c-957111d824fa'}}} Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf49f2d7-a56a-46e4-bb2c-957111d824fa is already attached to instances: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:47.609793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf49f2d7-a56a-46e4-bb2c-957111d824fa is already attached to instances: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:47.611171 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf49f2d7-a56a-46e4-bb2c-957111d824fa is already attached to instances: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 400 to user: Invalid volume: volume bf49f2d7-a56a-46e4-bb2c-957111d824fa is already attached to instances: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7abb29cb-929c-490b-aba5-b6d40b23828d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103444 Jun 24 08:23:47.612627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 356/711] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:23:47 2022] POST /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:23:47.649252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:47.671839 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:47.672393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.678498 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.678946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.680145 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.680145 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.760429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'services' on Instance uuid 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:47.805676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-80f06f1a-09e2-4ea6-ac7d-81858f6e7765 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "DELETE /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 204 len: 0 microversion: 2.1 time: 0.477196 Jun 24 08:23:47.807052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 356/712] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:47 2022] DELETE /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:23:47.816966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:47.817709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.824217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.824657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.832358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.832358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.929064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9e2710ef-215a-416f-bbda-1b92ab1c793f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments/bf49f2d7-a56a-46e4-bb2c-957111d824fa" status: 202 len: 0 microversion: 2.1 time: 0.260948 Jun 24 08:23:47.929863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 357/713] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:23:47 2022] DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments/bf49f2d7-a56a-46e4-bb2c-957111d824fa => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:23:47.938830 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:47.940043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.946681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.947128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.947898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.948378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.963042 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:47.970658 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-decbb3b8-83d0-448d-b49c-db8ac0458144 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1578 microversion: 2.1 time: 0.157878 Jun 24 08:23:47.971223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 357/714] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:47 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:47.975904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:47.976546 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:47.979401 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9c4b9622-0410-4189-a73d-9d017215b933 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Jun 24 08:23:47.980436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 358/715] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:47 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:23:47.983449 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.983887 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:47.984669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:47.985096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:48.046435 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:48.053743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b0238610-3e20-4987-82c7-c561e6932e1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1287 microversion: 2.1 time: 0.081581 Jun 24 08:23:48.054298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 358/716] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:47 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:48.406953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:48.407577 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:48.413951 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:48.414391 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:48.415132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:48.415794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:48.428723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] HTTP exception thrown: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 could not be found. Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Request method failure captured: Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 HTTP/1.1 Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZBwTmdq5yAzMMjF96X7yeJ3d8jP1znACExJ4UN2fZLT3CsTKbSXox-XyNtrUxZ57VcL_BBgmhIYr5PzBAiI2iBNP8gjGURsnmqAb6w_gkRFw5xKpLgJhQclVWQs5Yf5UzOEvgX6-fqxq6v_iNcYqeyfWat8p4cr7Zm-UjUuCbS1o Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:23:48.430355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e79436f86e1e4038a7b0e41cf468bb62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}] Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 5ebbd67cca66411ea52e4b92478564cf Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 could not be found. Jun 24 08:23:48.431920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '4a24c2d2-6c59-4080-8eb6-4f0431fd54d4'} Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 could not be found. Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:48.433284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 could not be found. Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 could not be found. Jun 24 08:23:48.434736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:48.436138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Returning 404 to user: Instance 4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:48.436138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e087a9dc-450a-4e1b-8759-275d154421a1 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4" status: 404 len: 111 microversion: 2.1 time: 0.028556 Jun 24 08:23:48.436138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 359/717] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:48 2022] GET /compute/v2.1/servers/4a24c2d2-6c59-4080-8eb6-4f0431fd54d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:23:48.440615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-51fc6d0a-2bf5-4b65-ae48-8f6422c2a15d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '.version_select at 0x7f14961bca60>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:48.519726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-51fc6d0a-2bf5-4b65-ae48-8f6422c2a15d tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203928592" status: 202 len: 0 microversion: 2.1 time: 0.082923 Jun 24 08:23:48.520312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 359/718] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 24 08:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203928592 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:23:48.992003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:48.992258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:48.992828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:48.993274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:48.999464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:48.999907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:49.000523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:49.000712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:49.001146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:49.001245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:49.002072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:49.002636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:49.034847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-30467ae0-1cc6-4cd3-9913-dfa2dfaf7fc7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046564 Jun 24 08:23:49.035645 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 360/719] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:48 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:49.071001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:49.072129 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:49.078100 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:49.078661 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:49.079469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:49.079878 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:49.185702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:49.193029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-17592502-f80e-4e9a-89f2-a33876d8e401 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1287 microversion: 2.1 time: 0.125835 Jun 24 08:23:49.193594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 361/720] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:49 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:49.223101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:49.231126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5e876716-5190-49e7-83a6-cc4ca2c385a7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1578 microversion: 2.1 time: 0.243029 Jun 24 08:23:49.231678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 360/721] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:48 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:50.047014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:50.048605 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:50.054955 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:50.055411 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:50.056164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:50.056629 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:50.087133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-27614a84-8b60-470e-8dca-950eed63977a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Jun 24 08:23:50.088599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 362/722] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:50 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:50.210341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:50.210965 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:50.217274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:50.217794 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:50.218752 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:50.219343 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:50.249613 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:50.250482 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:50.257120 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:50.257772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:50.258907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:50.260409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:50.291956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:50.300720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-28f4aa36-ac2f-4cd6-ba58-2434d6218b66 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1295 microversion: 2.1 time: 0.094132 Jun 24 08:23:50.301304 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 361/723] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:50 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:50.427427 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:50.436130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cfd6fd5b-7360-45d4-9caf-32da50ae867b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1578 microversion: 2.1 time: 0.191271 Jun 24 08:23:50.436732 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 363/724] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:50 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:51.099032 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:51.099964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:51.106622 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.107068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.107839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.108311 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.136462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-88afe80b-f5ad-44b8-a071-541e16b7673e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041281 Jun 24 08:23:51.136954 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 362/725] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:23:51 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:23:51.195298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:51.195905 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:51.202362 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.202815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.203964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.204089 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.230511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:51.319159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:51.319754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:51.326275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.326722 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.327486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.327946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.391412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:51.399540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d4680e96-6f8b-44c3-a55d-f91fb1151aa6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1293 microversion: 2.1 time: 0.084388 Jun 24 08:23:51.401269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 363/726] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:51 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:51.453859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:51.454574 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:51.460710 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.461234 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.462088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.463206 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.533023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:51.537949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bfc8f16a-d2cf-4a86-8ef8-b5e7c26ddfa4 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1510 microversion: 2.1 time: 0.087984 Jun 24 08:23:51.538516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 364/727] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:51 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:51.563652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3a305921-c87d-43ae-bac6-1a76ee13a3ff tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 204 len: 0 microversion: 2.1 time: 0.372415 Jun 24 08:23:51.570244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 364/728] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:51 2022] DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:23:51.580188 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:51.580188 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:51.584238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.584880 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.585814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.586249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.680748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-261ca1d1-eb98-499e-b02c-0a8331576ffb req-e42bc6cb-3233-4180-80e7-52e781c5490d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401989f0-8369-4e86-92c8-76b65a93f9cb", "name": "network-vif-deleted", "tag": "28a38618-88aa-4717-b585-2dc906547505"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:51.697607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-261ca1d1-eb98-499e-b02c-0a8331576ffb req-e42bc6cb-3233-4180-80e7-52e781c5490d service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.709007 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-261ca1d1-eb98-499e-b02c-0a8331576ffb req-e42bc6cb-3233-4180-80e7-52e781c5490d service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.723175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-261ca1d1-eb98-499e-b02c-0a8331576ffb req-e42bc6cb-3233-4180-80e7-52e781c5490d service nova] Creating event network-vif-deleted:28a38618-88aa-4717-b585-2dc906547505 for instance 401989f0-8369-4e86-92c8-76b65a93f9cb on hv-cinder-83482 Jun 24 08:23:51.739847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-261ca1d1-eb98-499e-b02c-0a8331576ffb req-e42bc6cb-3233-4180-80e7-52e781c5490d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064857 Jun 24 08:23:51.742965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 365/729] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:51.775955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:51.787784 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8dd7387f-531d-4656-9ded-a2f6ce302f77 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1681 microversion: 2.1 time: 0.219170 Jun 24 08:23:51.788656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 365/730] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:51 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:51.961020 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:51.961597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:51.967784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.968266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.969029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:51.969463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:51.996101 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:52.021741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:52.336598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c3beabbb-2e16-4c3d-906b-ed3a78118e81 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 204 len: 0 microversion: 2.1 time: 0.379478 Jun 24 08:23:52.337672 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 366/731] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:51 2022] DELETE /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:23:52.345567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:52.346731 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:52.352630 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.353747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.359262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.359262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.419593 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:52.420620 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:52.427545 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.427998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.428851 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.429424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.546824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:52.552670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:52.559367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-803ffd91-90b1-405f-9c8f-dc085ea23b8a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1506 microversion: 2.1 time: 0.217497 Jun 24 08:23:52.560103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 366/732] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:52 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:52.565960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:52.566869 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:52.582364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.583292 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.584259 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.585677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.596961 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:52.605681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bd4ce95d-1a0f-45e3-988f-27fdca545f89 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.191725 Jun 24 08:23:52.606451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 367/733] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:52 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:52.655735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:52.664024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ca53a908-1c60-433e-9bfb-143245ca62f3 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1510 microversion: 2.1 time: 0.101694 Jun 24 08:23:52.664786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 367/734] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:52 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1510 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:52.805833 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:52.806516 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:52.812982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.813437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.814369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:52.814799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:52.948576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:52.956172 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5fbc1f78-1a5e-48c6-872e-2f5d69847603 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1681 microversion: 2.1 time: 0.154277 Jun 24 08:23:52.956755 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 368/735] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:52 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:53.577524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:53.599742 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:53.615786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.615786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.615786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.615786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.623862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:53.624627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:53.631413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.632409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.633400 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.634656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.842485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:53.850176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-50e4efb1-71c3-48c9-bfb9-8302f2ad0974 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1506 microversion: 2.1 time: 0.276498 Jun 24 08:23:53.850745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 368/736] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:53 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:53.861136 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:53.861136 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:53.861458 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:53.865372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.865814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.866578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.867107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.867648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f8e6dd43-9ec8-4c26-b52b-61a527762ede tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.248880 Jun 24 08:23:53.868571 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 369/737] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:53 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:53.937845 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-45a357f9-4d2f-4b89-b444-e3f7cfe58256 req-a02b9ca3-df33-4077-b579-98b0e2454fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15961e4-d216-43b1-91e0-7fddf8d5338a", "tag": "53f745be-6a67-4554-8568-9b03438d1041"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:53.946025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-45a357f9-4d2f-4b89-b444-e3f7cfe58256 req-a02b9ca3-df33-4077-b579-98b0e2454fd2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.946476 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-45a357f9-4d2f-4b89-b444-e3f7cfe58256 req-a02b9ca3-df33-4077-b579-98b0e2454fd2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.951302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:53.959456 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-45a357f9-4d2f-4b89-b444-e3f7cfe58256 req-a02b9ca3-df33-4077-b579-98b0e2454fd2 service nova] Creating event network-changed:53f745be-6a67-4554-8568-9b03438d1041 for instance f15961e4-d216-43b1-91e0-7fddf8d5338a on hv-cinder-83482 Jun 24 08:23:53.960376 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-12d2397d-f0c1-419f-9f06-efc1ba46fa34 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1226 microversion: 2.1 time: 0.105856 Jun 24 08:23:53.965569 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-45a357f9-4d2f-4b89-b444-e3f7cfe58256 req-a02b9ca3-df33-4077-b579-98b0e2454fd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032559 Jun 24 08:23:53.966506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 370/738] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:23:53.970661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 369/739] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:53 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:53.975273 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:53.975971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:53.983174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.983598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:53.984602 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:53.985344 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:54.120649 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:54.128289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0746a0b8-d717-4011-82a7-41f03b7b68a1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1681 microversion: 2.1 time: 0.157537 Jun 24 08:23:54.128863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 371/740] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:53 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:54.867202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:54.867830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:54.874586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:54.875028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:54.875774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:54.876229 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:54.885341 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:54.885941 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:54.892342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:54.892793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:54.893550 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:54.893985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:55.073203 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:55.075964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:55.080612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-03277d6d-6713-4e3a-9458-e36133114e0a tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1506 microversion: 2.1 time: 0.217179 Jun 24 08:23:55.081269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 370/741] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:54 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:55.083502 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dc3a27e0-779f-401d-abed-531abaec6c94 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.202392 Jun 24 08:23:55.084222 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 372/742] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:54 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:55.085498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:55.086085 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:55.092424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:55.092865 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:55.093609 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:55.094031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:55.145625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:55.146225 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:55.152619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:55.153064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:55.153816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:55.154394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:55.159599 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:55.168530 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8e6c0a4c-e503-4693-a75a-e2446a4310cd tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1226 microversion: 2.1 time: 0.086354 Jun 24 08:23:55.169101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 371/743] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:55 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:55.284985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:55.293164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3b002507-d621-4cd6-950c-0ab351fa90ec tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1681 microversion: 2.1 time: 0.151299 Jun 24 08:23:55.293722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 373/744] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:55 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:56.097717 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:56.098915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:56.101103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:56.101419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:56.101852 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=6 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:56.102668 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:56.105085 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:56.107374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.107844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.108643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.109258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.111358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.111898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.112764 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.113443 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.331113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:56.335153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:56.341746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1ab8748b-f2b9-45aa-bd62-075d06d87fd6 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.245306 Jun 24 08:23:56.342637 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 374/745] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:56 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:56.347290 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:56.348590 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:56.352088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3947d205-5481-48ad-b76a-faaa90728eac tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1506 microversion: 2.1 time: 0.258642 Jun 24 08:23:56.362345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 372/746] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:56 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:56.362552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.362552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.362552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.362787 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:56.362876 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.362965 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:56.368544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.368943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.372190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.372190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.393421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:56.394045 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:56.394600 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lazy-loading 'fault' on Instance uuid 401989f0-8369-4e86-92c8-76b65a93f9cb {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:56.464782 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:56.472881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-823cd095-523b-4915-bf93-46ba9b3e23ca tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 200 len: 1231 microversion: 2.1 time: 0.128998 Jun 24 08:23:56.475752 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 375/747] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:56 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 1231 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:56.536399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:56.544629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a1f7e76d-1f3c-467c-9b6c-ffad5eec5c62 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1681 microversion: 2.1 time: 0.189971 Jun 24 08:23:56.545220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 373/748] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:56 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:57.358830 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:57.359399 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:57.366135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.366861 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.367815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.368483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.372831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:57.373527 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:57.403828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.405547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.406519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.407027 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.495992 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:57.504386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d078867b-abb8-460a-b139-ae1a9400dc46 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1464 microversion: 2.1 time: 0.137659 Jun 24 08:23:57.505225 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 374/749] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:57 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:57.520095 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:57.520991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:57.528619 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.529361 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.530392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.531092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.553828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] HTTP exception thrown: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Request method failure captured: Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb HTTP/1.1 Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXPB6jB1OwI0EwLDViEEYjHan2Zg-sPuzB-uWJt3YpsLalS6mUvzNaYTT8zJWE0WZcYgjr-GTbyRUqFnXK3qMWwIIdiSXeNxGLcCYMyqdLsZWOk_YNHqDmEM9V0miZiD1IAkfTbBz5rr7iYZyMuHpkvHTLVrrXitxIONIU0wpwbadlk Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:23:57.555505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9170777eb80e46bd9d8ea3a576a9678c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}] Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 01fe8c57517d4ca5958ec13139aa2b74 Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:23:57.556907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '401989f0-8369-4e86-92c8-76b65a93f9cb'} Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:57.557691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:23:57.559126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:23:57.561886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Returning 404 to user: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:57.563082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bce52d23-4bef-4ac2-9324-83676e29271e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 404 len: 111 microversion: 2.1 time: 0.046817 Jun 24 08:23:57.563815 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 375/750] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:57 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:23:57.564447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:57.576371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e748f1e1-000a-43d4-9c0d-154b1561c624 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.220209 Jun 24 08:23:57.577400 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 376/751] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:57 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:57.618121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:57.619774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:57.627842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.631681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.631681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.631681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.711329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:57.722098 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cd412432-e1a7-4831-8e1f-ab130758ab20 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1614 microversion: 2.1 time: 0.143402 Jun 24 08:23:57.723192 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 377/752] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:57 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:57.754790 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1555181017", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1900007784", "security_groups": [{"name": "tempest-secgroup-smoke-1452156496"}], "block_device_mapping_v2": [{"uuid": "ff9283b9-e81a-4f4f-8c1c-106a8e44b6a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b69c08d-6a46-414d-bcd2-12cdadfd6edc"}]}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:57.805021 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-84489c1d-20d6-43e5-83b1-d435afe3ad79 req-b12a239b-0e03-4342-b2b2-95781c230a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316723f1-2496-490c-a542-09dea2bc82c1", "name": "network-vif-deleted", "tag": "b0864fbb-b6bf-48ec-8cb1-9e0a270336cf"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:57.816885 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-84489c1d-20d6-43e5-83b1-d435afe3ad79 req-b12a239b-0e03-4342-b2b2-95781c230a31 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:57.817335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-84489c1d-20d6-43e5-83b1-d435afe3ad79 req-b12a239b-0e03-4342-b2b2-95781c230a31 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:57.831497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-84489c1d-20d6-43e5-83b1-d435afe3ad79 req-b12a239b-0e03-4342-b2b2-95781c230a31 service nova] Creating event network-vif-deleted:b0864fbb-b6bf-48ec-8cb1-9e0a270336cf for instance 316723f1-2496-490c-a542-09dea2bc82c1 on hv-cinder-83482 Jun 24 08:23:57.838007 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-84489c1d-20d6-43e5-83b1-d435afe3ad79 req-b12a239b-0e03-4342-b2b2-95781c230a31 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263425 Jun 24 08:23:57.838875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 376/753] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:57.919276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] validate_networks() for [('7b69c08d-6a46-414d-bcd2-12cdadfd6edc', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:23:58.145192 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:58.387600 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:23:58.388238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:23:58.388592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:23:58.389014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:23:58.389488 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:23:58.399254 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.400455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.401358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.401841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.419142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:23:58.423116 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for user 01fe8c57517d4ca5958ec13139aa2b74 and project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:23:58.481162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:23:58.483281 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff9283b9-e81a-4f4f-8c1c-106a8e44b6a0',volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:23:58.523747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:58.524483 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:58.530920 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.531370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.532141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.532606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.564225 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.564657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.565101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'fault' on Instance uuid 316723f1-2496-490c-a542-09dea2bc82c1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:23:58.609144 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:58.616554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4b1e8228-4e8f-4b97-9ddd-2e8df17e8d0e tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 200 len: 1311 microversion: 2.1 time: 0.097358 Jun 24 08:23:58.617126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 377/754] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:58 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:58.622125 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:58.622730 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:58.628593 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.629042 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.629799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.630234 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.768014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:58.775645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-29683cfd-34ff-426d-8aea-42d3ff92747f tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.157562 Jun 24 08:23:58.776288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 378/755] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:58 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:58.780847 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:58.781619 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:58.789890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.791187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.791981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:58.792449 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:58.861520 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:58.871454 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6c38909e-e553-4864-8223-32c8e678d14c tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1614 microversion: 2.1 time: 0.093966 Jun 24 08:23:58.872188 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 379/756] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:58 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:58.891984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-71e7f1f9-1481-4370-9031-7e542de57795 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.140950 Jun 24 08:23:58.892783 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 378/757] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:23:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:23:58.904698 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4290a7cb-a41b-4cdf-a900-d7fb2fb384ef tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:58.905135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4290a7cb-a41b-4cdf-a900-d7fb2fb384ef tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:58.963841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4290a7cb-a41b-4cdf-a900-d7fb2fb384ef tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:58.972517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4290a7cb-a41b-4cdf-a900-d7fb2fb384ef tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1095 microversion: 2.1 time: 0.072507 Jun 24 08:23:58.973091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 380/758] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:58 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:23:59.634359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:59.634976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 316723f1-2496-490c-a542-09dea2bc82c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:59.641961 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.642379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.643138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.643640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.657532 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] HTTP exception thrown: Instance 316723f1-2496-490c-a542-09dea2bc82c1 could not be found. Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Request method failure captured: Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 HTTP/1.1 Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZBwTmdq5yAzMMjF96X7yeJ3d8jP1znACExJ4UN2fZLT3CsTKbSXox-XyNtrUxZ57VcL_BBgmhIYr5PzBAiI2iBNP8gjGURsnmqAb6w_gkRFw5xKpLgJhQclVWQs5Yf5UzOEvgX6-fqxq6v_iNcYqeyfWat8p4cr7Zm-UjUuCbS1o Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:23:59.659177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e79436f86e1e4038a7b0e41cf468bb62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}] Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 5ebbd67cca66411ea52e4b92478564cf Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 316723f1-2496-490c-a542-09dea2bc82c1 could not be found. Jun 24 08:23:59.662355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '316723f1-2496-490c-a542-09dea2bc82c1'} Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316723f1-2496-490c-a542-09dea2bc82c1 could not be found. Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:23:59.663218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316723f1-2496-490c-a542-09dea2bc82c1 could not be found. Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316723f1-2496-490c-a542-09dea2bc82c1 could not be found. Jun 24 08:23:59.664947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:23:59.666243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Returning 404 to user: Instance 316723f1-2496-490c-a542-09dea2bc82c1 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:23:59.666243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-aeb8759a-5598-4b5b-b0c5-838d513813d4 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1" status: 404 len: 111 microversion: 2.1 time: 0.030802 Jun 24 08:23:59.666243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 379/759] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:59 2022] GET /compute/v2.1/servers/316723f1-2496-490c-a542-09dea2bc82c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:23:59.669647 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:59.670156 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:59.676129 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.676634 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.677404 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.677817 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.703325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:23:59.793156 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:59.793760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:59.799745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.800184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.800956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.801391 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.934538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:23:59.941960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-34ed84c3-e0ab-4eb6-874c-9bbd923ec717 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.153398 Jun 24 08:23:59.942538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:59 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:23:59.947005 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-27bbd0c0-f6c0-4911-bf4e-6fb96e19a4e3 req-bd987343-7c1a-4122-8258-ff1e6438fdbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb69e2f-11a1-4083-9b37-e10f77cc3ce0", "name": "network-vif-deleted", "tag": "83d7f299-eea9-449a-ab6f-539ebb3654ea"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:23:59.955652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-27bbd0c0-f6c0-4911-bf4e-6fb96e19a4e3 req-bd987343-7c1a-4122-8258-ff1e6438fdbc service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.956047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-27bbd0c0-f6c0-4911-bf4e-6fb96e19a4e3 req-bd987343-7c1a-4122-8258-ff1e6438fdbc service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.966875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-27bbd0c0-f6c0-4911-bf4e-6fb96e19a4e3 req-bd987343-7c1a-4122-8258-ff1e6438fdbc service nova] Creating event network-vif-deleted:83d7f299-eea9-449a-ab6f-539ebb3654ea for instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 on hv-cinder-83482 Jun 24 08:23:59.971480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-27bbd0c0-f6c0-4911-bf4e-6fb96e19a4e3 req-bd987343-7c1a-4122-8258-ff1e6438fdbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027867 Jun 24 08:23:59.972087 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 381/761] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:23:59.979329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:23:59.979329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:23:59.983840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.984318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:23:59.985187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:23:59.985556 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.020835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.021279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.021724 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:24:00.062401 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:00.069885 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-701ef6d8-df0b-44cb-a219-b0fe8c4244ed tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1331 microversion: 2.1 time: 0.096688 Jun 24 08:24:00.070442 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 382/762] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:23:59 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:00.075937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:00.076556 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:00.082186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.082626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.083374 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.083799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.123809 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ef5897aa-b414-4bd3-89e3-65775dd9e298 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 204 len: 0 microversion: 2.1 time: 0.458021 Jun 24 08:24:00.124755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 381/763] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:23:59 2022] DELETE /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:24:00.133526 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:00.134473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:00.141528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.141980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.142740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.143168 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.150016 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:00.158505 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-439f8378-c137-43ec-8880-435ae16ec9c5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1145 microversion: 2.1 time: 0.087098 Jun 24 08:24:00.159072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 383/764] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:00 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:00.281598 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:00.288933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a07f7c92-e564-474d-8529-7a8f9ec118cf tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.160001 Jun 24 08:24:00.289492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 382/765] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:00 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:00.959432 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:00.959998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:00.966994 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.967434 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.968177 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:00.968627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:00.984285 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:01.086790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:01.087393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:01.094449 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.094886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.095645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.096072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.104960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:01.112369 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-edb0dc08-d0f0-4485-9ff9-90e070c050bb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.156877 Jun 24 08:24:01.113122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 384/766] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:00 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:01.127121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.127557 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.127995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:24:01.130686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:01.170004 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:01.177273 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d220c83b-435e-4ef4-9dc5-6c26780e1628 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1331 microversion: 2.1 time: 0.094247 Jun 24 08:24:01.177828 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 383/767] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:01 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:01.180676 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:01.181283 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:01.187652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.188096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.188885 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.189318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.248888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:01.256303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4ee3c28d-bdcd-4b7a-8912-7cbcb394e74e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1137 microversion: 2.1 time: 0.079452 Jun 24 08:24:01.256877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 385/768] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:01 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1137 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:01.306345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:01.306998 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:01.313915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.314357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.315112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:01.315545 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:01.444312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:01.452424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6c737f5d-544a-42b4-b461-6c83ffb3a6e6 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.149944 Jun 24 08:24:01.452991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 384/769] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:01 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:02.129308 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:02.129848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:02.136396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.136840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.137586 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.138009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.194761 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:02.195457 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:02.202237 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.202679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.203430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.203855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.235721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.236154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.236621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:24:02.287618 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:02.292622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:02.296284 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ae7be770-825b-44b1-82f9-7b67b3f38074 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1331 microversion: 2.1 time: 0.105275 Jun 24 08:24:02.296804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 385/770] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:02 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:02.300182 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-76ae2ad1-be2b-44a9-b9d3-dd99a9430440 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.174839 Jun 24 08:24:02.301030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 386/771] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:02 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:02.301693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:02.302333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:02.308439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.308883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.309638 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.310064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.370599 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:02.377802 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-25da14d4-2b52-40a9-9b96-935f74ab9b4d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1137 microversion: 2.1 time: 0.080086 Jun 24 08:24:02.378357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 386/772] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:02 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1137 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:02.469679 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:02.470238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:02.476127 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.476606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.477366 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:02.477798 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:02.608354 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:02.615728 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-234f2945-8a33-4541-a6e5-b13ea65611bd tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.149982 Jun 24 08:24:02.616310 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 387/773] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:02 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:03.313720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:03.314325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:03.316362 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:03.316970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:03.320484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.320935 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.322028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.322372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.324046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.324516 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.325269 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.325701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.354673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.355117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.355563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:24:03.423478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:03.431731 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-21219c20-818f-43f2-9c17-273820550565 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 200 len: 1331 microversion: 2.1 time: 0.121956 Jun 24 08:24:03.441824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 387/774] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:03 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:03.441824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:03.441824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:03.448697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.449257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.450525 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.450966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.530105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:03.536795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:03.539298 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-282ca525-0202-43c6-b5b8-0cf3870a7e7d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1137 microversion: 2.1 time: 0.104979 Jun 24 08:24:03.546688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-76e7d2d5-73a0-4809-a492-8f0da0015aef tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.233989 Jun 24 08:24:03.546925 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 388/775] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:03 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1137 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:03.551855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-4ce2827c-63a1-47a6-a4df-dc6e7a6e7802 req-24bc6315-c3d7-4045-ae0e-81047a84cbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15961e4-d216-43b1-91e0-7fddf8d5338a", "name": "network-vif-plugged", "status": "completed", "tag": "53f745be-6a67-4554-8568-9b03438d1041"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:03.555820 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 388/776] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:03 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:03.560358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-4ce2827c-63a1-47a6-a4df-dc6e7a6e7802 req-24bc6315-c3d7-4045-ae0e-81047a84cbe5 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.561245 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-4ce2827c-63a1-47a6-a4df-dc6e7a6e7802 req-24bc6315-c3d7-4045-ae0e-81047a84cbe5 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.572215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-4ce2827c-63a1-47a6-a4df-dc6e7a6e7802 req-24bc6315-c3d7-4045-ae0e-81047a84cbe5 service nova] Creating event network-vif-plugged:53f745be-6a67-4554-8568-9b03438d1041 for instance f15961e4-d216-43b1-91e0-7fddf8d5338a on hv-cinder-83482 Jun 24 08:24:03.582479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-4ce2827c-63a1-47a6-a4df-dc6e7a6e7802 req-24bc6315-c3d7-4045-ae0e-81047a84cbe5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034267 Jun 24 08:24:03.583063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 389/777] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:03.632581 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:03.633193 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:03.640376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.640828 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.641597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:03.642030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:03.783778 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:03.794692 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a500d28f-5c85-4179-a185-ff935448091f tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1521 microversion: 2.1 time: 0.163334 Jun 24 08:24:03.795579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 389/778] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:03 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:04.337511 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-4552d27e-797b-4891-8152-e37511973554 req-0ee0baa7-3c8e-4e27-a8ac-1730a599843a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c224ed6-de35-4bae-a7c8-730721a700c0", "name": "network-vif-deleted", "tag": "072982f9-ed8e-452f-86d8-8f755a82116b"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:04.345895 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-4552d27e-797b-4891-8152-e37511973554 req-0ee0baa7-3c8e-4e27-a8ac-1730a599843a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.346333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-4552d27e-797b-4891-8152-e37511973554 req-0ee0baa7-3c8e-4e27-a8ac-1730a599843a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.357454 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-4552d27e-797b-4891-8152-e37511973554 req-0ee0baa7-3c8e-4e27-a8ac-1730a599843a service nova] Creating event network-vif-deleted:072982f9-ed8e-452f-86d8-8f755a82116b for instance 1c224ed6-de35-4bae-a7c8-730721a700c0 on hv-cinder-83482 Jun 24 08:24:04.362252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-4552d27e-797b-4891-8152-e37511973554 req-0ee0baa7-3c8e-4e27-a8ac-1730a599843a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028759 Jun 24 08:24:04.362814 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 390/779] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:04.448857 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:04.449507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:04.456223 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.456666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.457409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.457856 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.471677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 HTTP/1.1 Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:24:04.473307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:24:04.474952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '2cb69e2f-11a1-4083-9b37-e10f77cc3ce0'} Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:04.475881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:24:04.477479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:04.479539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:04.479539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-631011f5-79f6-4278-b84b-03ea56f7c9e5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 404 len: 111 microversion: 2.1 time: 0.029726 Jun 24 08:24:04.479539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 390/780] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:04 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:24:04.484744 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-31712874-00a0-4dc8-b95d-11c411d4b806 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '.version_select at 0x7f14962e7b80>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:04.553573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-31712874-00a0-4dc8-b95d-11c411d4b806 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139581554" status: 202 len: 0 microversion: 2.1 time: 0.072859 Jun 24 08:24:04.554033 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 391/781] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 24 08:24:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139581554 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:24:04.558745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:04.559255 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:04.563088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:04.564008 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:04.568251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.568251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.568251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.568251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.570676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.571312 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.572140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.574417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.644448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:04.655448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-39dfa4f0-1bf7-4900-ad1a-17083047d98a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1201 microversion: 2.1 time: 0.101121 Jun 24 08:24:04.656321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 391/782] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:04 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:04.797798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:04.805324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0fcac71a-ad1c-4ae4-a3ec-e27d89bebbfb tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1360 microversion: 2.1 time: 0.245927 Jun 24 08:24:04.805826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 392/783] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:04 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:04.817327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:04.817937 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:04.824556 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.825003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.825758 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:04.826192 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:04.887471 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:04.894901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-19bd878d-2d45-4085-9707-bcbf9bff2810 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1307 microversion: 2.1 time: 0.081350 Jun 24 08:24:04.895427 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 392/784] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:04 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:05.676778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3ce3bdf4-0693-4487-b18e-222b3201679d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: .version_select at 0x7f1496354940>, body: {"keypair": {"name": "tempest-keypair-2054702730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvjKkZmumWGv1xohBabHnJ3Hq8poUkf7wkFKP9F7dMleLkKGsY5y2R9qHLUCAmo+hlOY0dWYKzqPOwgcyO4K8rMteuVA2yMpTyh+xDxuCO/DAbWh4L9oDuC2UI48sF7/A=="}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:05.676778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:05.676778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-3ce3bdf4-0693-4487-b18e-222b3201679d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:24:05.676778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-3ce3bdf4-0693-4487-b18e-222b3201679d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:24:05.677960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:05.677960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:05.681233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.685210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.685210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.685210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.742972 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:05.750930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9d98c16d-e752-4b1c-98ad-4c89eb50e151 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1211 microversion: 2.1 time: 0.081669 Jun 24 08:24:05.751493 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 393/785] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:05 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:05.759772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3ce3bdf4-0693-4487-b18e-222b3201679d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126921 Jun 24 08:24:05.762486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 393/786] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:24:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:05.828241 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:05.828853 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:05.835106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.837202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.837202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.837202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.913254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:05.913864 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:05.921162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.921615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.922386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.922824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.955101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:05.955549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:05.955996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lazy-loading 'fault' on Instance uuid 1c224ed6-de35-4bae-a7c8-730721a700c0 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:24:06.024788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebbd67cca66411ea52e4b92478564cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79436f86e1e4038a7b0e41cf468bb62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:06.033485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-26d81e7b-a828-41a1-b8af-d87b5f5d90c8 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 200 len: 1312 microversion: 2.1 time: 0.124505 Jun 24 08:24:06.042998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:06.043686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 394/787] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:05 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:06.051439 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-13fdce2a-68be-44c4-8380-2421bbaf8d12 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1545 microversion: 2.1 time: 0.227104 Jun 24 08:24:06.056274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 394/788] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:05 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1545 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:06.070923 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:06.071430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:06.077958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:06.082567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:06.082567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:06.082567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:06.177964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fb6d03c3-8540-41c0-9e7a-f08b32efeaac tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110762 Jun 24 08:24:06.179251 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 395/789] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:24:06 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:06.770245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:06.774006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:06.778508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:06.778998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:06.780001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:06.780462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:07.051001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:07.051622 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] [instance: 1c224ed6-de35-4bae-a7c8-730721a700c0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:07.060118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:07.060754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:07.061642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:07.062198 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:07.087116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] HTTP exception thrown: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 could not be found. Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Request method failure captured: Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 HTTP/1.1 Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNZBwTmdq5yAzMMjF96X7yeJ3d8jP1znACExJ4UN2fZLT3CsTKbSXox-XyNtrUxZ57VcL_BBgmhIYr5PzBAiI2iBNP8gjGURsnmqAb6w_gkRFw5xKpLgJhQclVWQs5Yf5UzOEvgX6-fqxq6v_iNcYqeyfWat8p4cr7Zm-UjUuCbS1o Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:24:07.090345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e79436f86e1e4038a7b0e41cf468bb62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e79436f86e1e4038a7b0e41cf468bb62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e79436f86e1e4038a7b0e41cf468bb62"}]}] Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: e79436f86e1e4038a7b0e41cf468bb62 Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071619237 Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 5ebbd67cca66411ea52e4b92478564cf Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071619237-project Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 could not be found. Jun 24 08:24:07.091712 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '1c224ed6-de35-4bae-a7c8-730721a700c0'} Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 could not be found. Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:07.092669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 could not be found. Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 could not be found. Jun 24 08:24:07.093919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:07.096640 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] Returning 404 to user: Instance 1c224ed6-de35-4bae-a7c8-730721a700c0 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:07.100600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b0fd5c3b-8c20-499d-bd05-f5f1527fd4a3 tempest-ServerRescueNegativeTestJSON-1071619237 tempest-ServerRescueNegativeTestJSON-1071619237-project] 10.222.0.42 "GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0" status: 404 len: 111 microversion: 2.1 time: 0.050597 Jun 24 08:24:07.100600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 396/790] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:07 2022] GET /compute/v2.1/servers/1c224ed6-de35-4bae-a7c8-730721a700c0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:24:07.142551 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:07.151334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bc7254cd-f06d-49b4-8345-1cfadaa1e1cb tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1279 microversion: 2.1 time: 0.384261 Jun 24 08:24:07.152703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 395/791] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:06 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:07.831538 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-e9d81a36-5090-48c8-b0b4-6a4caa086442 req-db377831-69e1-4f1c-abb9-5e2faafceb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdae3c8-cd18-4640-9b59-23bc29ae1383", "tag": "49476779-f723-492d-a807-c92bf6bf2ca5"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:07.841670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-e9d81a36-5090-48c8-b0b4-6a4caa086442 req-db377831-69e1-4f1c-abb9-5e2faafceb9b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:07.842440 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-e9d81a36-5090-48c8-b0b4-6a4caa086442 req-db377831-69e1-4f1c-abb9-5e2faafceb9b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:07.858109 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-e9d81a36-5090-48c8-b0b4-6a4caa086442 req-db377831-69e1-4f1c-abb9-5e2faafceb9b service nova] Creating event network-changed:49476779-f723-492d-a807-c92bf6bf2ca5 for instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 on hv-cinder-83482 Jun 24 08:24:07.869328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-e9d81a36-5090-48c8-b0b4-6a4caa086442 req-db377831-69e1-4f1c-abb9-5e2faafceb9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041233 Jun 24 08:24:07.871168 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 397/792] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:08.173364 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:08.174690 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:08.201341 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:08.201794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:08.202578 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:08.203014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:08.282182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-8baf28a3-6805-4a68-800f-3ad3a519296d req-833515c7-d77a-4612-923d-30b36abb93ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15961e4-d216-43b1-91e0-7fddf8d5338a", "tag": "53f745be-6a67-4554-8568-9b03438d1041"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:08.296140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-8baf28a3-6805-4a68-800f-3ad3a519296d req-833515c7-d77a-4612-923d-30b36abb93ed service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:08.297631 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-8baf28a3-6805-4a68-800f-3ad3a519296d req-833515c7-d77a-4612-923d-30b36abb93ed service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:08.314081 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-8baf28a3-6805-4a68-800f-3ad3a519296d req-833515c7-d77a-4612-923d-30b36abb93ed service nova] Creating event network-changed:53f745be-6a67-4554-8568-9b03438d1041 for instance f15961e4-d216-43b1-91e0-7fddf8d5338a on hv-cinder-83482 Jun 24 08:24:08.326470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-8baf28a3-6805-4a68-800f-3ad3a519296d req-833515c7-d77a-4612-923d-30b36abb93ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146885 Jun 24 08:24:08.327700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 398/793] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:24:08.409926 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:08.430457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:08.454732 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:08.468123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-658f1e3c-c297-4a61-ad77-d6fa1b5b7e05 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.303164 Jun 24 08:24:08.475047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 396/794] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:08 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:09.494204 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:09.496060 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:09.502883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:09.503564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:09.504716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:09.505372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:09.716640 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:09.735732 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-207b1044-f183-4e67-ac97-686681f62d86 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.235853 Jun 24 08:24:09.735732 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 399/795] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:09 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:10.077184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-106784174", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7"}], "security_groups": [{"name": "tempest-securitygroup--1103347499"}], "key_name": "tempest-keypair-2054702730", "user_data": "}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:10.191863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] validate_networks() for [('be1a0b6f-9e7a-4324-b9a9-1d4d114e5bc7', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:24:10.598014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:24:10.598444 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:24:10.598946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:24:10.599352 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:24:10.599790 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:24:10.609713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:10.610162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:10.610958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:10.611394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:10.628667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:24:10.632919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Getting quotas for user 633cfb032a0344619f95e72492e85b9c and project a14e04756d06417da712e47759853a06. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:24:10.644384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:24:10.646689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:24:10.747227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:10.747905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:10.749792 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ce59f845-a4b1-429e-9787-042700d462ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677525 Jun 24 08:24:10.751060 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 397/796] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:24:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:24:10.756474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:10.757624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:10.758614 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:10.759366 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:10.770857 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8a3e8c19-9683-4398-8499-7802abdd2a82 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:10.776734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8a3e8c19-9683-4398-8499-7802abdd2a82 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:10.865478 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8a3e8c19-9683-4398-8499-7802abdd2a82 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:10.876469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8a3e8c19-9683-4398-8499-7802abdd2a82 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1241 microversion: 2.1 time: 0.118729 Jun 24 08:24:10.877423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 398/797] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:10 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:10.974765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:10.982551 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b19a1844-5c2b-4ef7-b01f-662c6117073c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.243538 Jun 24 08:24:10.983117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 400/798] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:10 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:11.895818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:11.897318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:11.905102 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:11.909595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:11.909595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:11.909595 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:11.980167 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:11.988511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-74fccf6f-be74-42c3-900c-fca2c3bee40a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1245 microversion: 2.1 time: 0.097263 Jun 24 08:24:12.000634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 399/799] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:11 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:12.003673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:12.004374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:12.013441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:12.013441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:12.014043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:12.014474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:12.165490 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:12.173019 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1cd8cd60-9658-41fc-8055-a66956612bea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.177322 Jun 24 08:24:12.173586 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 401/800] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:11 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:13.006716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:13.007752 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:13.015508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:13.024599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:13.024599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:13.024599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:13.091965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:13.099656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b799464e-39c2-4f91-9bf5-9ac6c65ff832 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1311 microversion: 2.1 time: 0.097003 Jun 24 08:24:13.100548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 400/801] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:13 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:13.190290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:13.190890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:13.197724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:13.198254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:13.199083 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:13.199667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:13.356574 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:13.364556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ebd1707b-6c0a-461b-98e5-b927ca01f8c7 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.177869 Jun 24 08:24:13.368645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 402/802] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:13 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:14.131333 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9402d5b3-1796-4031-9850-b2857ee35bbe tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Action: 'create', calling method: .version_select at 0x7f1496183280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1968191703", "metadata": {"Type": "work"}}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9402d5b3-1796-4031-9850-b2857ee35bbe tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Request method failure captured: Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 122 Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXSt8C-AxjbO65soho0XSfxmjY9oIdwohT9i0aeZlkbdfZN1mnMD8EmEg2XECBo8880eVllbyPrAuKnNsYm6TiGHnzqlEbYVEZoHsapEj6P4bwv5W69T5BGdngVU-enBY0wYjC5qG6x3lugKLE6_sfpd6SnmH0vQ0K6ivRs8va8JHMY Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:24:14.149975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba1bb028809433dbda6fd92dff46d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}] Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: b0bc05fef71d40409406ce024b33b4bc Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1968191703", "metadata": {"Type": "work"}}} Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: Jun 24 08:24:14.152336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1968191703', 'metadata': {'Type': 'work'}}}} Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:14.153322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:24:14.159009 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9402d5b3-1796-4031-9850-b2857ee35bbe tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9402d5b3-1796-4031-9850-b2857ee35bbe tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.082698 Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 403/803] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 24 08:24:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:14.160829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:14.167776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.168302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.169438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.169873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.196298 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:14.196847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:14.203538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.203987 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.204788 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.205443 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.232860 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-14fb344e-1c98-4487-95a7-8d6ad031189b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/ips" status: 200 len: 151 microversion: 2.20 time: 0.248959 Jun 24 08:24:14.233727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 401/804] 10.222.0.42 () {60 vars in 1288 bytes} [Fri Jun 24 08:24:13 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/ips => generated 151 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:24:14.240399 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0c6415f2-e6c3-4647-82cf-4b8f0735b62d tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Action: 'create', calling method: .version_select at 0x7f14960a0d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-764061354", "metadata": {"Type": "work"}}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0c6415f2-e6c3-4647-82cf-4b8f0735b62d tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Request method failure captured: Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 119 Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXSt8C-AxjbO65soho0XSfxmjY9oIdwohT9i0aeZlkbdfZN1mnMD8EmEg2XECBo8880eVllbyPrAuKnNsYm6TiGHnzqlEbYVEZoHsapEj6P4bwv5W69T5BGdngVU-enBY0wYjC5qG6x3lugKLE6_sfpd6SnmH0vQ0K6ivRs8va8JHMY Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:24:14.245359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba1bb028809433dbda6fd92dff46d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}] Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: b0bc05fef71d40409406ce024b33b4bc Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-764061354", "metadata": {"Type": "work"}}} Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: Jun 24 08:24:14.253259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-764061354', 'metadata': {'Type': 'work'}}}} Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi '0' Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:14.254896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:24:14.256949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:24:14.259737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:24:14.259737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.259737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0c6415f2-e6c3-4647-82cf-4b8f0735b62d tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:14.259737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0c6415f2-e6c3-4647-82cf-4b8f0735b62d tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011976 Jun 24 08:24:14.259737 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 402/805] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 24 08:24:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:24:14.261676 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-82a8aca2-4fda-48b7-ba11-8d7e00cc15a4 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Action: 'create', calling method: .version_select at 0x7f149608df70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-141520648", "metadata": {"Type": "work"}}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-82a8aca2-4fda-48b7-ba11-8d7e00cc15a4 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Request method failure captured: Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 118 Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXSt8C-AxjbO65soho0XSfxmjY9oIdwohT9i0aeZlkbdfZN1mnMD8EmEg2XECBo8880eVllbyPrAuKnNsYm6TiGHnzqlEbYVEZoHsapEj6P4bwv5W69T5BGdngVU-enBY0wYjC5qG6x3lugKLE6_sfpd6SnmH0vQ0K6ivRs8va8JHMY Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:24:14.264185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba1bb028809433dbda6fd92dff46d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}] Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: b0bc05fef71d40409406ce024b33b4bc Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-141520648", "metadata": {"Type": "work"}}} Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: Jun 24 08:24:14.265852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-141520648', 'metadata': {'Type': 'work'}}}} Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi '' Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:14.266818 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:24:14.268506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:24:14.269667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:24:14.269667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.269667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-82a8aca2-4fda-48b7-ba11-8d7e00cc15a4 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:14.269667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-82a8aca2-4fda-48b7-ba11-8d7e00cc15a4 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014161 Jun 24 08:24:14.272362 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 403/806] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 24 08:24:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:24:14.283484 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d6605036-bbdf-490d-bc16-cdc0881f93b9 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Calling method '.version_select at 0x7f14960c2a60>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:14.312812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-d6605036-bbdf-490d-bc16-cdc0881f93b9 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] HTTP exception thrown: Volume tempest-invalid-236308451 could not be found. Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d6605036-bbdf-490d-bc16-cdc0881f93b9 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Request method failure captured: Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-236308451 HTTP/1.1 Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXSt8C-AxjbO65soho0XSfxmjY9oIdwohT9i0aeZlkbdfZN1mnMD8EmEg2XECBo8880eVllbyPrAuKnNsYm6TiGHnzqlEbYVEZoHsapEj6P4bwv5W69T5BGdngVU-enBY0wYjC5qG6x3lugKLE6_sfpd6SnmH0vQ0K6ivRs8va8JHMY Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:24:14.314821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba1bb028809433dbda6fd92dff46d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}] Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: b0bc05fef71d40409406ce024b33b4bc Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Volume tempest-invalid-236308451 could not be found. Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'tempest-invalid-236308451'} Jun 24 08:24:14.316431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-236308451 could not be found. (HTTP 404) (Request-ID: req-0428991b-5fad-4c80-b56f-a7acfdeee119) Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.317422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:24:14.318677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-236308451 could not be found. Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:24:14.320174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-236308451 could not be found. Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-236308451 could not be found. Jun 24 08:24:14.321648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.322436 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:14.329488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a1f5fd3a-cbdc-4aa6-809f-c708e1d472ae tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.175132 Jun 24 08:24:14.329957 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d6605036-bbdf-490d-bc16-cdc0881f93b9 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Returning 404 to user: Volume tempest-invalid-236308451 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:14.330098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 404/807] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:14 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:14.338634 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d6605036-bbdf-490d-bc16-cdc0881f93b9 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-236308451" status: 404 len: 98 microversion: 2.1 time: 0.060682 Jun 24 08:24:14.340806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 404/808] 10.222.0.42 () {58 vars in 1214 bytes} [Fri Jun 24 08:24:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-236308451 => generated 98 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:24:14.350194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e7562990-a957-4f97-b196-1b397c400ffa tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004092 Jun 24 08:24:14.350976 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 405/809] 10.222.0.42 () {58 vars in 1139 bytes} [Fri Jun 24 08:24:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:24:14.359816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-33fb72be-95c2-466d-92a1-837ce99a902a tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003711 Jun 24 08:24:14.360528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 405/810] 10.222.0.42 () {58 vars in 1136 bytes} [Fri Jun 24 08:24:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:24:14.378043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-44ac94b5-373c-4ba8-85c0-60f7c44bced2 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Calling method '.version_select at 0x7f14961bc1f0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:14.391969 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:14.394777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:14.406387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.407094 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.407898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.408698 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.411153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-44ac94b5-373c-4ba8-85c0-60f7c44bced2 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] HTTP exception thrown: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-44ac94b5-373c-4ba8-85c0-60f7c44bced2 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Request method failure captured: Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/os-volumes/468e46ed-207a-4ffc-88c8-ad98f33e2fcb HTTP/1.1 Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXSt8C-AxjbO65soho0XSfxmjY9oIdwohT9i0aeZlkbdfZN1mnMD8EmEg2XECBo8880eVllbyPrAuKnNsYm6TiGHnzqlEbYVEZoHsapEj6P4bwv5W69T5BGdngVU-enBY0wYjC5qG6x3lugKLE6_sfpd6SnmH0vQ0K6ivRs8va8JHMY Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:24:14.413386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba1bb028809433dbda6fd92dff46d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}] Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: b0bc05fef71d40409406ce024b33b4bc Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '468e46ed-207a-4ffc-88c8-ad98f33e2fcb'} Jun 24 08:24:14.418015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. (HTTP 404) (Request-ID: req-be661148-2ed8-41e9-95a9-cd97177b0c1f) Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.419529 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:24:14.420677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:24:14.421771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.423269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-44ac94b5-373c-4ba8-85c0-60f7c44bced2 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Returning 404 to user: Volume 468e46ed-207a-4ffc-88c8-ad98f33e2fcb could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:14.425767 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-44ac94b5-373c-4ba8-85c0-60f7c44bced2 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/468e46ed-207a-4ffc-88c8-ad98f33e2fcb" status: 404 len: 109 microversion: 2.1 time: 0.044018 Jun 24 08:24:14.426480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 406/811] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:24:14 2022] DELETE /compute/v2.1/os-volumes/468e46ed-207a-4ffc-88c8-ad98f33e2fcb => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:24:14.438087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2b59977f-d2b7-4fc3-ac5c-eed4d10ce000 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Calling method '.version_select at 0x7f1496204af0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:14.493584 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-2b59977f-d2b7-4fc3-ac5c-eed4d10ce000 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] HTTP exception thrown: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2b59977f-d2b7-4fc3-ac5c-eed4d10ce000 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Request method failure captured: Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/os-volumes/7c33123c-f2ea-477e-9121-7de1a01c7867 HTTP/1.1 Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXSt8C-AxjbO65soho0XSfxmjY9oIdwohT9i0aeZlkbdfZN1mnMD8EmEg2XECBo8880eVllbyPrAuKnNsYm6TiGHnzqlEbYVEZoHsapEj6P4bwv5W69T5BGdngVU-enBY0wYjC5qG6x3lugKLE6_sfpd6SnmH0vQ0K6ivRs8va8JHMY Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:24:14.495694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba1bb028809433dbda6fd92dff46d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba1bb028809433dbda6fd92dff46d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba1bb028809433dbda6fd92dff46d1b"}]}] Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 9ba1bb028809433dbda6fd92dff46d1b Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesNegativeTest-120250454 Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: b0bc05fef71d40409406ce024b33b4bc Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesNegativeTest-120250454-project Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '7c33123c-f2ea-477e-9121-7de1a01c7867'} Jun 24 08:24:14.497504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. (HTTP 404) (Request-ID: req-114f891b-bf17-4ab7-8263-3144ffe222fa) Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.498472 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:24:14.500030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:24:14.503937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2b59977f-d2b7-4fc3-ac5c-eed4d10ce000 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] Returning 404 to user: Volume 7c33123c-f2ea-477e-9121-7de1a01c7867 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2b59977f-d2b7-4fc3-ac5c-eed4d10ce000 tempest-VolumesNegativeTest-120250454 tempest-VolumesNegativeTest-120250454-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7c33123c-f2ea-477e-9121-7de1a01c7867" status: 404 len: 109 microversion: 2.1 time: 0.064549 Jun 24 08:24:14.505536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 407/812] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:24:14 2022] GET /compute/v2.1/os-volumes/7c33123c-f2ea-477e-9121-7de1a01c7867 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:24:14.612566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:14.622528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-30b6e056-fe91-4c07-99c2-e972f3f0af6a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.237947 Jun 24 08:24:14.623111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 406/813] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:14 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:14.788494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-97984f5e-fc1d-420a-8ec9-13fbcd7fb23e req-057a28cd-26e1-4e7b-b08b-90d0f99cde9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24daa898-2b62-4e1e-8c27-3e451302f4c1", "tag": "3c3bd4d7-8f27-40c9-a1f4-937dda0530cf"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:14.797914 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-97984f5e-fc1d-420a-8ec9-13fbcd7fb23e req-057a28cd-26e1-4e7b-b08b-90d0f99cde9f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:14.798669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-97984f5e-fc1d-420a-8ec9-13fbcd7fb23e req-057a28cd-26e1-4e7b-b08b-90d0f99cde9f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:14.813719 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-97984f5e-fc1d-420a-8ec9-13fbcd7fb23e req-057a28cd-26e1-4e7b-b08b-90d0f99cde9f service nova] Creating event network-changed:3c3bd4d7-8f27-40c9-a1f4-937dda0530cf for instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 on hv-cinder-83482 Jun 24 08:24:14.820052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-97984f5e-fc1d-420a-8ec9-13fbcd7fb23e req-057a28cd-26e1-4e7b-b08b-90d0f99cde9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036110 Jun 24 08:24:14.820703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 408/814] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:15.347089 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:15.347701 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:15.354138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:15.354585 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:15.355346 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:15.355781 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:15.508938 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:15.511860 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:15.517917 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ec4913ac-9165-4150-873a-4dcc958e0d58 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.174714 Jun 24 08:24:15.518493 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 407/815] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:15 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:15.639473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:15.640178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:15.646498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:15.646941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:15.647714 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:15.648149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:15.663357 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=6 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:15.668181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:15.797172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:15.804740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2ffe3cd5-c934-400f-aa4e-57bc78287043 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.169444 Jun 24 08:24:15.805405 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 409/816] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:15 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:16.485273 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:16.486441 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:16.493403 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:16.493847 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:16.495155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:16.495567 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:16.518694 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lazy-loading 'flavor' on Instance uuid e05b5a06-e026-4f8e-af25-d7f2d95c29c4 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:24:16.535330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:16.540608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:16.542966 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:16.543463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:16.544236 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:16.544666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:16.679782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:16.688307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-25fff114-1cb8-4a9a-851f-979cee4573ee tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.156589 Jun 24 08:24:16.688871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 410/817] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:16 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:16.822871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:16.823484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:16.836450 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:16.839959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:16.840905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:16.841380 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:16.983656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:17.001916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5c54912e-bcbe-4305-a30a-923385e2d0d2 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.172594 Jun 24 08:24:17.001916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 411/818] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:16 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:17.074209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-132b4a50-a9cd-45ae-af2e-719b6c0a5a5f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/action" status: 202 len: 0 microversion: 2.20 time: 0.593588 Jun 24 08:24:17.079130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 408/819] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 24 08:24:16 2022] POST /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:24:17.085946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:17.086553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:17.093488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:17.093935 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:17.094697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:17.095131 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:17.224582 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:17.233022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:17.234515 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:17.235656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b18a323c-20f7-4dbe-aee0-56533de31c70 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.156673 Jun 24 08:24:17.236232 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 412/820] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:17 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:24:17.706469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:17.707164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:17.713677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:17.714632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:17.714879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:17.715314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:17.848919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:17.857199 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ded92b35-aed5-405b-aaa1-741942c2ecf5 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.155393 Jun 24 08:24:17.860418 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 409/821] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:17 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:18.009957 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:18.010686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:18.017916 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:18.021072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:18.021072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:18.021072 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:18.174607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:18.187498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4da11be0-6153-4662-82b5-0772d653882b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.181624 Jun 24 08:24:18.188554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 413/822] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:18 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:18.254530 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:18.255226 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:18.261689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:18.262187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:18.263040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:18.263544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:18.395003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:18.403666 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:18.405180 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:18.406541 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-05dc47fc-441b-4b36-bcd6-50ba29db5e28 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.156038 Jun 24 08:24:18.407172 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 410/823] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:18 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:18.874666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:18.875275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:18.881326 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:18.881770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:18.882523 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:18.882952 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:19.017817 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:19.025680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1a264e56-16ef-4eed-b569-a2e7e857af45 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.154819 Jun 24 08:24:19.026240 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 414/824] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:18 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:19.204253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:19.204772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:19.211150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:19.211599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:19.212383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:19.213309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:19.347950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:19.356184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fc15dba1-5077-464f-b495-65a6e8649a5c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.155596 Jun 24 08:24:19.356762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 411/825] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:19 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:19.425468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:19.426065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:19.432669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:19.433365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:19.434203 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:19.434594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:19.566845 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:19.575249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:19.576884 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:19.578171 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-70842cdb-7206-4580-b1f0-9e3de8686a66 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.156624 Jun 24 08:24:19.588604 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 415/826] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:19 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:19.835971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-b705e4f1-a97d-45a2-ab99-dc0d11f232c1 req-8c1e1eec-da94-4f51-a07a-f53dcf15ca3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdae3c8-cd18-4640-9b59-23bc29ae1383", "name": "network-vif-plugged", "status": "completed", "tag": "49476779-f723-492d-a807-c92bf6bf2ca5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:19.845904 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-b705e4f1-a97d-45a2-ab99-dc0d11f232c1 req-8c1e1eec-da94-4f51-a07a-f53dcf15ca3f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:19.846343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-b705e4f1-a97d-45a2-ab99-dc0d11f232c1 req-8c1e1eec-da94-4f51-a07a-f53dcf15ca3f service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.017116 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-b705e4f1-a97d-45a2-ab99-dc0d11f232c1 req-8c1e1eec-da94-4f51-a07a-f53dcf15ca3f service nova] Creating event network-vif-plugged:49476779-f723-492d-a807-c92bf6bf2ca5 for instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 on hv-cinder-83482 Jun 24 08:24:20.021900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-b705e4f1-a97d-45a2-ab99-dc0d11f232c1 req-8c1e1eec-da94-4f51-a07a-f53dcf15ca3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315732 Jun 24 08:24:20.022536 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 412/827] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:20.042297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:20.042886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:20.049008 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:20.049455 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.050202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:20.050634 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.184693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:20.193386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f7e9ba0b-a72f-49a5-adee-9b190f86a533 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.153856 Jun 24 08:24:20.193386 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 416/828] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:20 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:20.373563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:20.374197 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:20.381013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:20.381456 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.382199 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:20.382624 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.515840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:20.523263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fca5121f-295a-471d-8000-ab3feefcec7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.154467 Jun 24 08:24:20.523816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 413/829] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:20 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:20.597528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:20.598130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:20.604607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:20.605047 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.605795 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:20.606220 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:20.740356 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:20.748951 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:20.750471 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:20.751624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-af8b9f10-ece9-4cac-b12e-e16f4e082776 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.157990 Jun 24 08:24:20.752176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 417/830] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:20 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:21.211713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:21.212342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:21.216337 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:21.217454 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=8 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:21.220932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:21.221389 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:21.222122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:21.222578 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:21.362691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:21.371137 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-73245875-a5cb-4e66-b5be-0846e8eadc83 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.163149 Jun 24 08:24:21.375091 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 414/831] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:21 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:21.539384 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:21.540094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:21.546100 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:21.546616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:21.547439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:21.547959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:21.694420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:21.702455 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3500174e-5675-4208-9a58-c104b60642e5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1267 microversion: 2.1 time: 0.166824 Jun 24 08:24:21.703277 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 418/832] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:21 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:21.775070 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:21.775875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:21.778248 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:21.783047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:21.783486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:21.784252 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:21.784678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:21.917200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:21.925879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:21.927453 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:21.928703 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fe26e78f-3b72-403e-906a-ab442f123ce5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.157757 Jun 24 08:24:21.929299 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 415/833] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:21 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:22.037047 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-1b940e6e-a949-4456-9b91-b3d661fe90e1 req-d1863cb0-7485-483d-a31f-310d3bb7ad77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24daa898-2b62-4e1e-8c27-3e451302f4c1", "name": "network-vif-plugged", "status": "completed", "tag": "3c3bd4d7-8f27-40c9-a1f4-937dda0530cf"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:22.045774 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-1b940e6e-a949-4456-9b91-b3d661fe90e1 req-d1863cb0-7485-483d-a31f-310d3bb7ad77 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.046204 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-1b940e6e-a949-4456-9b91-b3d661fe90e1 req-d1863cb0-7485-483d-a31f-310d3bb7ad77 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.058677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-1b940e6e-a949-4456-9b91-b3d661fe90e1 req-d1863cb0-7485-483d-a31f-310d3bb7ad77 service nova] Creating event network-vif-plugged:3c3bd4d7-8f27-40c9-a1f4-937dda0530cf for instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 on hv-cinder-83482 Jun 24 08:24:22.063515 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-1b940e6e-a949-4456-9b91-b3d661fe90e1 req-d1863cb0-7485-483d-a31f-310d3bb7ad77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 Jun 24 08:24:22.064078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 419/834] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:24:22.388678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:22.389379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:22.395610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.396129 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.396973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.397414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.532855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:22.539340 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-109b3d42-bd92-41fb-8bd6-69e2f9f32124 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.154946 Jun 24 08:24:22.539897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 416/835] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:22 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:22.720165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:22.720898 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:22.727105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.732223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.732223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.740552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.880908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:22.889315 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d76468cf-c78b-4bc2-8af8-09e502089bc0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1454 microversion: 2.1 time: 0.173352 Jun 24 08:24:22.889886 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 420/836] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:22 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:22.906854 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:22.907452 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:22.914000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.914442 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.915209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.915635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.954122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:22.955098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:22.963910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.964690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:22.965715 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:22.966153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:23.113342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:23.122067 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-88a13723-9047-421e-b97b-333bfd303414 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1454 microversion: 2.1 time: 0.219721 Jun 24 08:24:23.127843 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 417/837] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:22 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:24:23.140181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:23.148532 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:23.150124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:23.151565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9c2dcdab-7df7-43bf-80a1-1a1e76d6eb2b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.207921 Jun 24 08:24:23.152124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 421/838] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:22 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:23.557103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:23.557863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:23.564066 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:23.564543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:23.565318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:23.565745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:23.747062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:23.754503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6123a031-703c-4bcd-b393-daeb3a0e1da3 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.201170 Jun 24 08:24:23.755479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 418/839] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:23 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:24.169075 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:24.169761 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:24.175663 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:24.176104 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:24.176893 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:24.177326 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:24.410544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:24.419552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:24.421235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:24.422466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-21939586-e296-4ad3-b6c2-4b651b1b2165 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.257375 Jun 24 08:24:24.423124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 422/840] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:24 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:24.773572 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:24.774206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:24.781871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:24.782314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:24.787240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:24.787240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:25.012326 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:25.019862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fa485c90-6857-4d7f-9054-260d927c840a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1367 microversion: 2.1 time: 0.250654 Jun 24 08:24:25.020463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 419/841] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:24 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:25.442820 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:25.444062 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:25.451635 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:25.452087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:25.453095 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:25.453601 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:25.492944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-4de85aa3-44ac-4778-b491-227f452cf673 req-f8a6dda2-e572-4d92-a1a7-df2fcfc82f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdae3c8-cd18-4640-9b59-23bc29ae1383", "tag": "49476779-f723-492d-a807-c92bf6bf2ca5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:25.503098 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-4de85aa3-44ac-4778-b491-227f452cf673 req-f8a6dda2-e572-4d92-a1a7-df2fcfc82f8b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:25.503772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-4de85aa3-44ac-4778-b491-227f452cf673 req-f8a6dda2-e572-4d92-a1a7-df2fcfc82f8b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:25.519199 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-4de85aa3-44ac-4778-b491-227f452cf673 req-f8a6dda2-e572-4d92-a1a7-df2fcfc82f8b service nova] Creating event network-changed:49476779-f723-492d-a807-c92bf6bf2ca5 for instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 on hv-cinder-83482 Jun 24 08:24:25.524678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-4de85aa3-44ac-4778-b491-227f452cf673 req-f8a6dda2-e572-4d92-a1a7-df2fcfc82f8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035360 Jun 24 08:24:25.525860 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 420/842] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:24:25.650550 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:25.659268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:25.661078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:25.662344 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-892b2ec4-a1bb-4a70-8547-90dbf601993c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.223296 Jun 24 08:24:25.663064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 423/843] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:25 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:26.038415 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:26.039724 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:26.047043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:26.047816 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:26.048635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:26.049070 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:26.188741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:26.196217 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6e69896e-0721-49cc-8fb2-a2e8772c53a9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1556 microversion: 2.1 time: 0.162165 Jun 24 08:24:26.196789 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 421/844] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:24:26 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:24:26.213846 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:26.214448 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:26.220695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:26.221268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:26.222095 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:26.222604 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:26.313616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-26fc1045-1843-4556-9301-8cc4fd5d18e7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104749 Jun 24 08:24:26.314211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 424/845] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 24 08:24:26 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:26.681367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:26.682332 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:26.688682 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:26.689135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:26.689975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:26.690416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:26.903263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:26.911582 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:26.916832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:26.916832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-87e5b1d5-10a3-4306-9ad3-f61a589ef5d6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.237032 Jun 24 08:24:26.916832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 422/846] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:26 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:27.552215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-13a73fd1-de49-47f7-82e4-c2018b6390d8 req-8d749ea9-7cba-4eca-8360-373e9edf45cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24daa898-2b62-4e1e-8c27-3e451302f4c1", "tag": "3c3bd4d7-8f27-40c9-a1f4-937dda0530cf"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:27.561237 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-13a73fd1-de49-47f7-82e4-c2018b6390d8 req-8d749ea9-7cba-4eca-8360-373e9edf45cb service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:27.561963 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-13a73fd1-de49-47f7-82e4-c2018b6390d8 req-8d749ea9-7cba-4eca-8360-373e9edf45cb service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:27.576138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-13a73fd1-de49-47f7-82e4-c2018b6390d8 req-8d749ea9-7cba-4eca-8360-373e9edf45cb service nova] Creating event network-changed:3c3bd4d7-8f27-40c9-a1f4-937dda0530cf for instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 on hv-cinder-83482 Jun 24 08:24:27.581683 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-13a73fd1-de49-47f7-82e4-c2018b6390d8 req-8d749ea9-7cba-4eca-8360-373e9edf45cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033789 Jun 24 08:24:27.582355 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 425/847] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:27.944487 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:27.946650 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:27.961712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:27.962603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:27.964179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:27.965006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:28.116903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:28.120247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:28.127048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:28.128624 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:28.129815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7054e4f1-779c-4015-93f0-a1e711cd09e7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1743 microversion: 2.20 time: 0.200632 Jun 24 08:24:28.130660 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 423/848] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:27 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:29.148020 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:29.148724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:29.155423 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:29.155861 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:29.156635 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:29.157068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:29.288441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:29.297419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:29.298897 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:29.300057 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-447eca06-7de8-4f02-b897-38e64f57e826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1743 microversion: 2.20 time: 0.156278 Jun 24 08:24:29.300639 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 426/849] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:29 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:30.318028 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:30.318626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:30.325778 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:30.326224 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:30.326983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:30.327409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:30.471240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:30.479594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:30.481717 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:30.482480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e0c71b6d-3cf6-4e70-b601-700060e29e2e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.168338 Jun 24 08:24:30.483029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 424/850] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:30 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:31.501351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:31.502145 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:31.511465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:31.512399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:31.513414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:31.514059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:31.637152 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-ac36c59e-5df8-4a3e-83fe-fe1718453944 req-74f608d1-4794-45da-8a4e-e71695a76ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "name": "network-vif-plugged", "status": "completed", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:31.649447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-ac36c59e-5df8-4a3e-83fe-fe1718453944 req-74f608d1-4794-45da-8a4e-e71695a76ef4 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:31.650140 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-ac36c59e-5df8-4a3e-83fe-fe1718453944 req-74f608d1-4794-45da-8a4e-e71695a76ef4 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:31.662632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-ac36c59e-5df8-4a3e-83fe-fe1718453944 req-74f608d1-4794-45da-8a4e-e71695a76ef4 service nova] Creating event network-vif-plugged:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:24:31.668768 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-ac36c59e-5df8-4a3e-83fe-fe1718453944 req-74f608d1-4794-45da-8a4e-e71695a76ef4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035990 Jun 24 08:24:31.670507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 425/851] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:24:31.693525 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:31.700864 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:31.706223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:31.707780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:31.709153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2191d35b-811b-476e-844f-ef520feef782 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.211823 Jun 24 08:24:31.709707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 427/852] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:31 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:32.729546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:32.730238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:32.740297 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:32.741025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:32.742125 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:32.742724 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:32.932053 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:32.941087 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:32.942855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:32.944274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4e478b5f-690c-4942-a825-46c1e0fb60c6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.220956 Jun 24 08:24:32.945181 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 426/853] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:32 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:24:33.965912 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:33.966554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:33.972486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:33.972928 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:33.973685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:33.974112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:34.113249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:34.121363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:34.122862 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:34.124016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8974a199-1b95-4dce-8d61-b4784cdbf9bb tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.163589 Jun 24 08:24:34.124602 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 428/854] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:33 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:24:35.143302 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:35.144729 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:35.154650 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:35.155267 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:35.156202 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:35.156661 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:35.310312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:35.319914 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:35.321447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:35.322901 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1e16b07b-e4ab-42b3-a436-68772609c775 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.183820 Jun 24 08:24:35.323507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 427/855] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:35 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:36.341779 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:36.343161 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:36.346411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:36.349876 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:36.350324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:36.351085 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:36.351523 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:36.495110 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:36.506115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:36.507582 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:36.508922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4718f296-60bd-4ffa-957b-43fad3c4d63c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.171655 Jun 24 08:24:36.518575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 429/856] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:36 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:37.529024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:37.529647 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:37.536435 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:37.536888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:37.537644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:37.538262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:37.713482 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:37.723367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:37.725423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:37.726872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0f39e128-f22a-4d53-8a75-336a6479a4a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.202601 Jun 24 08:24:37.732672 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 428/857] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:37 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:38.746645 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:38.747247 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:38.754278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:38.755131 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:38.756353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:38.757044 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:38.946596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:38.962352 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:38.964943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:38.966411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-dc12349a-a6a9-47d1-95f8-f58b10ae94fe tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.224536 Jun 24 08:24:38.967213 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 430/858] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:38 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:39.986405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:39.987008 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:39.995534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:39.995979 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:39.996781 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:39.997212 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:40.156157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:40.164912 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:40.166984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:40.168207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c18d1153-0e07-4ea1-84ec-963211cbb1df tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.186604 Jun 24 08:24:40.172383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 429/859] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:39 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:41.191341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:41.191341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:41.197689 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:41.198197 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:41.199036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:41.200126 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:41.360637 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:41.370290 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:41.373697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:41.380004 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8a1435b2-4e16-4c60-bea4-fef524438882 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.197009 Jun 24 08:24:41.381573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 431/860] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:41 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:42.398750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:42.399263 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:42.406309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:42.406754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:42.407501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:42.407931 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:42.542265 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:42.550345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:42.552055 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:42.553303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-030f6349-a39b-40b0-9a72-2ac31f5b266b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1738 microversion: 2.20 time: 0.158355 Jun 24 08:24:42.553851 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 430/861] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:42 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:43.572341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:43.572949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:43.579798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:43.580275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:43.581061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:43.581494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:43.715921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:43.724681 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:43.726329 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:43.727516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-534c99d1-43cc-4717-9f33-412fac91f1b5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1720 microversion: 2.20 time: 0.159054 Jun 24 08:24:43.728073 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 432/862] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:43 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:44.747276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:44.747876 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:44.754384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:44.754828 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:44.755574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:44.756003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:44.886393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:44.895359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:44.896880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:44.904217 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-115ba1b8-877a-4cc1-9e2d-a779bafac71d tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1720 microversion: 2.20 time: 0.155175 Jun 24 08:24:44.904217 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 431/863] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:44 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:45.916137 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:45.916776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:45.923418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:45.923861 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:45.924653 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:45.925083 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:46.054487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:46.062779 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:46.064319 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:46.065474 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-76e48bb2-3fcc-4d55-80bd-0de1f4918c36 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1723 microversion: 2.20 time: 0.153201 Jun 24 08:24:46.066026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 433/864] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:45 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:46.083470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beb505f3-10c4-4e69-9e29-0e42059e6d56"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:46.084565 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:46.091342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:46.091787 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:46.092583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:46.093019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:47.020132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b108a44a-aa93-4e63-9b36-35b7d8920b39 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.940668 Jun 24 08:24:47.020798 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 432/865] 10.222.0.42 () {62 vars in 1363 bytes} [Fri Jun 24 08:24:46 2022] POST /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-volume_attachments => generated 188 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:24:47.136720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:47.137740 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:47.143282 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:47.143729 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:47.144505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:47.144934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:48.515932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-0b937380-dcdd-4c2c-ba37-6b3169782f1e req-4bb90b98-be65-4b42-adeb-29fa0a402e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "name": "network-vif-unplugged", "status": "completed", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:48.529158 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-0b937380-dcdd-4c2c-ba37-6b3169782f1e req-4bb90b98-be65-4b42-adeb-29fa0a402e85 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:48.529604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-0b937380-dcdd-4c2c-ba37-6b3169782f1e req-4bb90b98-be65-4b42-adeb-29fa0a402e85 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:48.540507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-0b937380-dcdd-4c2c-ba37-6b3169782f1e req-4bb90b98-be65-4b42-adeb-29fa0a402e85 service nova] Creating event network-vif-unplugged:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:24:48.546136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-0b937380-dcdd-4c2c-ba37-6b3169782f1e req-4bb90b98-be65-4b42-adeb-29fa0a402e85 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034832 Jun 24 08:24:48.546715 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 433/866] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:48.699890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-11ff996f-222c-4cc3-8de6-bfd51f480138 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-volume_attachments/beb505f3-10c4-4e69-9e29-0e42059e6d56" status: 202 len: 0 microversion: 2.20 time: 1.566746 Jun 24 08:24:48.700631 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 434/867] 10.222.0.42 () {60 vars in 1456 bytes} [Fri Jun 24 08:24:47 2022] DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-volume_attachments/beb505f3-10c4-4e69-9e29-0e42059e6d56 => generated 0 bytes in 1568 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:24:48.756733 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:48.757381 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:48.763573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:48.764033 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:48.764798 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:48.765229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:49.017481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d62fef71-a764-4757-8407-3908b039b2a2 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "POST /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/action" status: 202 len: 0 microversion: 2.20 time: 0.264829 Jun 24 08:24:49.018197 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 434/868] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 24 08:24:48 2022] POST /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:24:49.025944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:49.026550 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:49.032702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:49.033147 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:49.033907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:49.034336 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:49.169797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:49.175726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:49.177254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:49.178400 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0fc72750-e313-4794-a0e4-52990aff2730 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1671 microversion: 2.20 time: 0.156291 Jun 24 08:24:49.178956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 435/869] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:49 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:50.207239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:50.207239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:50.207239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:50.207239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:50.207944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:50.210380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:50.340084 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:50.349189 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:50.350777 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:50.352030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d5955aa6-ac65-4174-abbd-b24dc540d3e5 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1671 microversion: 2.20 time: 0.158463 Jun 24 08:24:50.352680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 435/870] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:50 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:51.369720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:51.370325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:51.376322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:51.376770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:51.377521 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:51.377950 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:51.511324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:51.519815 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:51.521345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:51.522492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1ce96502-44b2-4cf1-8956-f9ed4c322d25 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1673 microversion: 2.20 time: 0.156613 Jun 24 08:24:51.523074 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 436/871] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:51 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:52.540903 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:52.541531 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:52.544049 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=44 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:52.548926 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:52.549379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:52.550128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:52.550564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:52.567546 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:52.568079 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:52.574036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:52.574484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:52.580783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:52.580783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:52.601216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0a0b754e-2a3b-4835-87ff-eadfbf703bd2 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/ips" status: 200 len: 145 microversion: 2.1 time: 0.038190 Jun 24 08:24:52.601803 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 437/872] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:24:52 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:24:52.683036 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:52.691573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:52.693088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:52.694414 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-136079bf-263a-46eb-b59a-aed501a2d083 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1673 microversion: 2.20 time: 0.157433 Jun 24 08:24:52.694970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 436/873] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:52 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:53.712658 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:53.713320 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:53.719487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:53.719926 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:53.720772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:53.721199 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:53.854148 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:53.862522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:53.864110 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:53.865303 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f808e55b-91c5-4f36-8916-73f58f85e3a7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1673 microversion: 2.20 time: 0.156618 Jun 24 08:24:53.865854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 438/874] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:53 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:54.259024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "787cc2cc-631b-4efc-9c2e-dc1525c844c6"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:24:54.260361 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:54.268684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:54.270136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:54.270136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:54.270545 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:54.517229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:54.884185 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:54.884807 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:54.891438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:54.891874 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:54.892716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:54.893095 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:55.024239 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:55.031989 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:55.033490 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:55.034688 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-621218eb-8d85-4046-8f3b-5f91edffd9e8 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.154400 Jun 24 08:24:55.035242 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 439/875] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:54 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:24:55.133477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8ffca67a-0039-4c14-9001-ec2b0698a970 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.878632 Jun 24 08:24:55.134176 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 437/876] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:24:54 2022] POST /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:24:56.052788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:56.053493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:56.061162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:56.061900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:56.062888 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:56.063576 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:56.209694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:56.218979 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:56.220794 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:56.222198 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8fe00326-c719-4e49-91d8-6c0e6f5659bd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.173613 Jun 24 08:24:56.226175 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 440/877] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:56 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:57.242147 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:57.243053 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:57.250004 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:57.250607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:57.251479 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:57.252019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:57.393705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:57.410722 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:57.413216 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:57.415284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-224bd42d-9ef2-4ac9-a06b-db71dea9bf84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.177653 Jun 24 08:24:57.416510 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 438/878] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:57 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:24:58.434021 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:58.434636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:58.440609 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:58.441056 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:58.441823 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:58.442334 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:58.593271 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:58.601214 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:58.602694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:58.603834 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-36d8a185-e87e-48de-ab3b-d11b855a1619 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.173967 Jun 24 08:24:58.604406 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 441/879] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:58 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:24:59.624728 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:24:59.625549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:24:59.635396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:59.635844 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:59.636627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:24:59.637062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:24:59.791233 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:59.792027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:59.794533 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:24:59.795694 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-be80e531-fbef-49ec-878e-44caba0bf5f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.176497 Jun 24 08:24:59.796273 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 439/880] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:24:59 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:00.815800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:00.820829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:00.828076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:00.830412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:00.830412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:00.830412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:00.848597 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:00.979921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:00.989827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:00.991362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:00.993113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-131fb951-24ba-46f7-888c-e044ba21458a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.181773 Jun 24 08:25:00.993870 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 442/881] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:00 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:02.011492 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:02.012716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:02.022091 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:02.023863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:02.023863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:02.024169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:02.175226 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:02.183966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:02.185832 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:02.187042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4a0c7e42-c820-45e0-bd34-5a9ae5ef624b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.179499 Jun 24 08:25:02.187599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 440/882] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:02 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:03.206148 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:03.207419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:03.214370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:03.214850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:03.216617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:03.217249 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:03.362307 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:03.370745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:03.373338 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:03.374642 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3a1aaaf2-44f1-470d-a1a0-5950e69d6f8a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.172742 Jun 24 08:25:03.375925 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 443/883] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:03 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:04.393408 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:04.394027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:04.400552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:04.400995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:04.401738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:04.402162 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:04.528376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:04.536279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:04.537700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:04.538875 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-12c4c0ad-c9e4-4f96-8ce6-1294c4c4b86b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.149279 Jun 24 08:25:04.539431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 441/884] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:04 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:05.557359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:05.557998 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:05.564914 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:05.565358 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:05.566116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:05.566545 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:05.702835 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:05.710706 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:05.712228 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:05.713378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-568c814a-c37c-4acb-b2e0-adea9b6fc08a tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.159808 Jun 24 08:25:05.714083 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 444/885] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:05 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:06.735544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:06.736325 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:06.742795 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:06.743247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:06.744003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:06.744470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:06.876419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:06.886289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:06.889472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:06.891143 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b91a7b94-1eb5-4beb-8e30-8883d572fb2f tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.159765 Jun 24 08:25:06.891896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 442/886] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:06 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:07.912379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:07.912984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:07.914854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=32 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:07.920096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:07.920592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:07.921366 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:07.921799 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:08.074936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:08.083295 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:08.084941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:08.086532 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c2f75f92-1581-4500-90e3-cc87a9bcd084 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.178677 Jun 24 08:25:08.087078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 445/887] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:07 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:08.106312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:08.106312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:08.110333 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:08.110786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:08.111557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:08.112024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:08.141967 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f9e7b2f3-50da-4b62-a506-dc3b8e8230cc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Jun 24 08:25:08.142517 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 443/888] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:08 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:08.152709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:08.153191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:08.159110 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:08.163856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:08.163856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:08.163856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:08.189507 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-67d9dd35-ac4c-48f2-a3ba-f744b61d7e51 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/787cc2cc-631b-4efc-9c2e-dc1525c844c6" status: 200 len: 194 microversion: 2.1 time: 0.040903 Jun 24 08:25:08.192826 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 446/889] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jun 24 08:25:08 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/787cc2cc-631b-4efc-9c2e-dc1525c844c6 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:09.104974 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:09.106384 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:09.112888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:09.113334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:09.114111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:09.114542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:09.253235 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:09.262018 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:09.263549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:09.265076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f7aa6734-c33f-4be1-8750-ca31e4bbc2f7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.163913 Jun 24 08:25:09.265890 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 444/890] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:09 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:10.283699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:10.284372 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:10.290389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:10.290837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:10.291602 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:10.292050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:10.423233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:10.430953 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:10.432465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:10.434453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-17bab962-199c-4d5c-9b92-24c31d902e45 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.154208 Jun 24 08:25:10.435007 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 447/891] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:10 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:11.452098 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:11.452684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:11.459358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:11.459806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:11.460605 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:11.461043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:11.598051 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:11.607678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:11.609217 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:11.610641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4a909bb2-4ce6-4e93-bdb5-1c1df71af3b6 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.162646 Jun 24 08:25:11.611784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 445/892] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:11 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:12.630238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:12.632059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:12.637130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:12.637571 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:12.638370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:12.638803 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:12.766937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:12.774883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:12.776419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:12.778157 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-50b421ad-5626-4e7a-bc44-8ab780119826 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.151759 Jun 24 08:25:12.778959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 448/893] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:12 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:13.033341 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19032bca-a43f-49ad-a5dd-4851d6419cc1"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:25:13.034399 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:13.040867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:13.041313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:13.042075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:13.042511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:13.796085 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:13.796741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:13.802556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:13.803004 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:13.803763 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:13.804287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:13.869946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a853486a-f8c1-463c-a8dd-b0c2d3ee5536 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "POST /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840298 Jun 24 08:25:13.870631 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 446/894] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:25:13 2022] POST /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:25:13.954148 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:13.962199 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:13.963679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:13.965296 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f75c303f-b91f-46b8-8365-d3c182470b4b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.173360 Jun 24 08:25:13.966478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 449/895] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:13 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:25:14.064048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-72a33ab4-bd64-498f-9cff-df4d4831b043 req-61c84652-8c19-4ccc-8b5e-92b7a5bcd7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "name": "network-vif-plugged", "status": "completed", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:25:14.073269 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-72a33ab4-bd64-498f-9cff-df4d4831b043 req-61c84652-8c19-4ccc-8b5e-92b7a5bcd7e1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:14.075698 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-72a33ab4-bd64-498f-9cff-df4d4831b043 req-61c84652-8c19-4ccc-8b5e-92b7a5bcd7e1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:14.086814 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-72a33ab4-bd64-498f-9cff-df4d4831b043 req-61c84652-8c19-4ccc-8b5e-92b7a5bcd7e1 service nova] Creating event network-vif-plugged:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:25:14.091849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-72a33ab4-bd64-498f-9cff-df4d4831b043 req-61c84652-8c19-4ccc-8b5e-92b7a5bcd7e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Jun 24 08:25:14.092457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 447/896] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:25:14.971743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:14.972258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:14.978165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:14.993668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:14.993668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:14.993668 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:14.994166 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:14.994166 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:14.994166 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:14.994166 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:14.994534 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:14.994631 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:15.003981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9356574c-22d9-4d3c-b225-a6765d7c48d7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/ips" status: 200 len: 148 microversion: 2.1 time: 0.036106 Jun 24 08:25:15.004769 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 450/897] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:25:14 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:15.130329 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:15.139351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:15.140899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:15.142880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ea39c777-9800-4828-8d06-6df5a919fda9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.162923 Jun 24 08:25:15.142880 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 448/898] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:14 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:25:16.160971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:16.161518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:16.168480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:16.168932 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:16.169691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:16.170124 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:16.305087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:16.313377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:16.314864 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:16.316004 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6f535378-0e72-4fcc-aa0e-89df03071b40 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.159013 Jun 24 08:25:16.316590 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 451/899] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:16 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:16.756367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "570b858f-1733-403e-a3ea-2753183e296b"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:25:16.757540 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:16.765200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:16.765590 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:16.766338 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:16.766765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:17.333925 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:17.334665 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:17.340782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:17.341217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:17.342181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:17.342580 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:17.477401 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:17.485849 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:17.487383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:17.488562 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1d0d979b-966f-4768-9f8a-ade1f68befcd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1729 microversion: 2.20 time: 0.158492 Jun 24 08:25:17.489109 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 452/900] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:17 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:17.834456 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-6cb6ae98-f2df-4d74-a566-918467d567b8 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "POST /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.079551 Jun 24 08:25:17.838981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 449/901] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:25:16 2022] POST /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments => generated 194 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:18.507331 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:18.508017 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:18.514952 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:18.515770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:18.516500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:18.516967 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:18.657063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:18.664777 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:18.666420 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:18.668286 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-62c7457a-3de5-45c9-b2b9-3c0645e3d650 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1716 microversion: 2.20 time: 0.164743 Jun 24 08:25:18.669044 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 453/902] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:18 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:22.528155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:22.529255 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:22.536079 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:22.536566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:22.537330 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:22.537916 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:22.570768 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f3de12ad-c25a-495a-a0f0-da441a182f15 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047438 Jun 24 08:25:22.571576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 450/903] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:22 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:22.731514 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:22.732023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:22.738743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:22.739186 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:22.739945 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:22.740596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:22.770118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a88264a6-2fb0-4785-ac4b-3336a89ec43e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/787cc2cc-631b-4efc-9c2e-dc1525c844c6" status: 200 len: 194 microversion: 2.1 time: 0.043316 Jun 24 08:25:22.770697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 454/904] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jun 24 08:25:22 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/787cc2cc-631b-4efc-9c2e-dc1525c844c6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:22.781533 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:22.782026 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:22.783958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=30 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:22.788619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:22.789062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:22.789814 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:22.790238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:22.805438 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=91,nova_cell1:INSERT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:22.874888 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lazy-loading 'services' on Instance uuid f15961e4-d216-43b1-91e0-7fddf8d5338a {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:25:23.213698 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-17b582ae-e030-4a92-aa06-e3532f1d4c9e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/787cc2cc-631b-4efc-9c2e-dc1525c844c6" status: 202 len: 0 microversion: 2.1 time: 0.437260 Jun 24 08:25:23.214429 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 451/905] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:25:22 2022] DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/787cc2cc-631b-4efc-9c2e-dc1525c844c6 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:25:30.721908 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:30.722466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:30.728644 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:30.729092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:30.729855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:30.730480 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:30.819239 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'services' on Instance uuid 24daa898-2b62-4e1e-8c27-3e451302f4c1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:25:31.111519 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cc557271-b0f6-4980-b7a1-20542ce0e82f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments/570b858f-1733-403e-a3ea-2753183e296b" status: 202 len: 0 microversion: 2.1 time: 0.393294 Jun 24 08:25:31.112252 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 455/906] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:25:30 2022] DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments/570b858f-1733-403e-a3ea-2753183e296b => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:25:31.121873 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:31.127244 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:31.130434 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:31.130915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:31.131708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:31.132240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:31.167201 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2da68c71-d7dc-4710-849e-f792bc252f8e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Jun 24 08:25:31.167201 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 452/907] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:31 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:31.698906 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:31.699473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:31.706174 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:31.706610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:31.707560 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:31.707991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:31.736662 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cc949e6f-03ef-4db5-9f14-71f23cfe083e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/19032bca-a43f-49ad-a5dd-4851d6419cc1" status: 200 len: 194 microversion: 2.1 time: 0.041891 Jun 24 08:25:31.737269 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 456/908] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jun 24 08:25:31 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/19032bca-a43f-49ad-a5dd-4851d6419cc1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:31.746807 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:31.747293 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:31.756984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:31.757431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:31.758188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:31.758614 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:31.843425 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lazy-loading 'services' on Instance uuid f15961e4-d216-43b1-91e0-7fddf8d5338a {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:25:32.108603 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0f13e4ca-501c-46f1-bcd3-e50207fe7311 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/19032bca-a43f-49ad-a5dd-4851d6419cc1" status: 202 len: 0 microversion: 2.1 time: 0.365412 Jun 24 08:25:32.109797 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 453/909] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:25:31 2022] DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments/19032bca-a43f-49ad-a5dd-4851d6419cc1 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:25:32.176706 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:32.177703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:32.184288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:32.184737 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:32.185537 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:32.186105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:32.215309 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9901c151-5bf5-4248-b197-0895442f454e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042646 Jun 24 08:25:32.215876 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 457/910] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:32 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:33.227643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:33.228712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:33.237866 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:33.237866 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:33.238079 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:33.238498 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:33.268522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2ec01261-78bd-47c6-b476-9a9e3e92609d tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045206 Jun 24 08:25:33.269088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 454/911] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:33 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:25:33.329481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:33.330016 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:33.336512 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:33.336971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:33.337791 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:33.338223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:33.341041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:33.365089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:25:33.720513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a924e319-edde-430c-9d41-c7f1a3ca1bd7 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 204 len: 0 microversion: 2.1 time: 0.395014 Jun 24 08:25:33.721041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 458/912] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:33 2022] DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:25:33.729520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:33.730131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:33.736229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:33.736677 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:33.737432 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:33.737861 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:33.868181 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:33.876964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-25fa51ed-e2f7-4412-9623-255693755a4e tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1680 microversion: 2.1 time: 0.151403 Jun 24 08:25:33.877521 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 455/913] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:33 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:34.323080 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:34.324088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:34.330637 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:34.331212 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:34.331812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:34.332265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:34.362288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-012be295-4acb-4b8a-b4d2-2a2d65a3cfd7 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Jun 24 08:25:34.362831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 459/914] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:34 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:34.893803 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:34.894323 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:34.900746 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:34.901194 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:34.901946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:34.902382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:35.051959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:35.059686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4470012d-3f19-4f54-8c43-93b74ca590b9 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1680 microversion: 2.1 time: 0.169749 Jun 24 08:25:35.061069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 456/915] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:34 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:35.374910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:35.375876 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:35.381780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:35.382217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:35.382975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:35.383395 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:35.412808 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bcd875ec-b4c6-4530-9396-f7612da2b581 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Jun 24 08:25:35.413359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 460/916] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:35 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:36.077843 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:36.078542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:36.085210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.085738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.086618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.087046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.233597 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:36.241194 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9996c694-0dd5-4369-83cb-a4345e8be78f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1680 microversion: 2.1 time: 0.167400 Jun 24 08:25:36.241765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 457/917] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:36 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:36.424535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:36.426907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:36.432283 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.432843 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.434100 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.435085 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.470946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8616c783-6bcd-400b-81c4-8723dcedae99 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050351 Jun 24 08:25:36.471509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 461/918] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:36 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:25:36.584077 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:36.585448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:36.592019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.592712 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.593608 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.594047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.624972 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1093312a-84ea-4217-9079-b375d4449d9b tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044769 Jun 24 08:25:36.625572 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 458/919] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:25:36 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 08:25:36.686976 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:36.687540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:36.693956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.698064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.698064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.698064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.723281 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:25:36.743249 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-16d42591-f85a-405e-a5f5-e66143ae79c5 req-fef6ab5e-0a49-4d32-99ce-34ccb6607a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24daa898-2b62-4e1e-8c27-3e451302f4c1", "name": "network-vif-deleted", "tag": "3c3bd4d7-8f27-40c9-a1f4-937dda0530cf"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:25:36.753238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-16d42591-f85a-405e-a5f5-e66143ae79c5 req-fef6ab5e-0a49-4d32-99ce-34ccb6607a27 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:36.753684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-16d42591-f85a-405e-a5f5-e66143ae79c5 req-fef6ab5e-0a49-4d32-99ce-34ccb6607a27 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:36.769160 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-16d42591-f85a-405e-a5f5-e66143ae79c5 req-fef6ab5e-0a49-4d32-99ce-34ccb6607a27 service nova] Creating event network-vif-deleted:3c3bd4d7-8f27-40c9-a1f4-937dda0530cf for instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 on hv-cinder-83482 Jun 24 08:25:36.774452 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-16d42591-f85a-405e-a5f5-e66143ae79c5 req-fef6ab5e-0a49-4d32-99ce-34ccb6607a27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Jun 24 08:25:36.775056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 459/920] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:25:37.121536 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fef3e003-34ef-4eec-953f-79a057b0fe6c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 204 len: 0 microversion: 2.1 time: 0.438926 Jun 24 08:25:37.123578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 462/921] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:36 2022] DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:25:37.132389 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:37.133741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:37.140978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:37.141707 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:37.142708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:37.143357 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:37.259132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:37.260080 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:37.267059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:37.267511 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:37.268308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:37.268747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:37.301880 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:37.302379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:37.302831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 24daa898-2b62-4e1e-8c27-3e451302f4c1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:25:37.321612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:37.344520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-be2f00e1-e0db-4308-b24c-21300d3806c3 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1670 microversion: 2.1 time: 0.216649 Jun 24 08:25:37.346498 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 460/922] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:37 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:37.357497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:37.366024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d924a393-0df5-4afe-aa10-fc211eff41f0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1331 microversion: 2.1 time: 0.111063 Jun 24 08:25:37.366907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 463/923] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:37 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:38.363161 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:38.363770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:38.370328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:38.370780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:38.371557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:38.372024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:38.385065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:38.385679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:38.387619 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:38.393158 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:38.393606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:38.394371 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:38.394844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:38.427192 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:38.427650 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:38.428101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 24daa898-2b62-4e1e-8c27-3e451302f4c1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:25:38.488707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:38.496142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b4f0bc72-135d-43ad-885d-c55851d9198f tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1331 microversion: 2.1 time: 0.114795 Jun 24 08:25:38.504260 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 464/924] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:38 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:25:38.539294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:38.547536 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-511f097d-964a-455c-ad16-bd447ce0e2a4 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1670 microversion: 2.1 time: 0.188341 Jun 24 08:25:38.548096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 461/925] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:38 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:39.514745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:39.522504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:39.522504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:39.522504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:39.523061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:39.523486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:39.556946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:39.557396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:39.559541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lazy-loading 'fault' on Instance uuid 24daa898-2b62-4e1e-8c27-3e451302f4c1 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:25:39.565046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:39.566175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:39.573193 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:39.573641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:39.574594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:39.575032 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:39.635762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cfb032a0344619f95e72492e85b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14e04756d06417da712e47759853a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:39.652302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-48ffe255-2fa9-4515-8b42-b94a463627ea tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 200 len: 1331 microversion: 2.1 time: 0.142158 Jun 24 08:25:39.653338 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 465/926] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:39 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:25:39.765101 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:39.772800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-2be02d99-50ea-4894-900d-d15003a0f2da tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1670 microversion: 2.1 time: 0.211814 Jun 24 08:25:39.773376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 462/927] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:39 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1670 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:25:40.592797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-2e6b1eaf-8d11-405d-ba9f-cbcd9e160b69 req-042b011c-dd94-4315-84be-0872a3efc3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15961e4-d216-43b1-91e0-7fddf8d5338a", "name": "network-vif-deleted", "tag": "53f745be-6a67-4554-8568-9b03438d1041"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:25:40.600872 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-2e6b1eaf-8d11-405d-ba9f-cbcd9e160b69 req-042b011c-dd94-4315-84be-0872a3efc3d1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:40.601313 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-2e6b1eaf-8d11-405d-ba9f-cbcd9e160b69 req-042b011c-dd94-4315-84be-0872a3efc3d1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:40.613592 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-2e6b1eaf-8d11-405d-ba9f-cbcd9e160b69 req-042b011c-dd94-4315-84be-0872a3efc3d1 service nova] Creating event network-vif-deleted:53f745be-6a67-4554-8568-9b03438d1041 for instance f15961e4-d216-43b1-91e0-7fddf8d5338a on hv-cinder-83482 Jun 24 08:25:40.618690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-2e6b1eaf-8d11-405d-ba9f-cbcd9e160b69 req-042b011c-dd94-4315-84be-0872a3efc3d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030443 Jun 24 08:25:40.623184 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 466/928] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:25:40.669638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:40.670243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:40.680101 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:40.683157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:40.683157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:40.683157 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:40.698267 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 HTTP/1.1 Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:40.699920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:40.702494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '24daa898-2b62-4e1e-8c27-3e451302f4c1'} Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:40.706088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:40.715343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:40.719509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:40.719509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b4326917-47d3-4a52-9627-cd45f4825301 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 404 len: 111 microversion: 2.1 time: 0.036242 Jun 24 08:25:40.719509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 463/929] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:40 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:40.720141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-09e41dd3-3c77-4e0a-9475-405691820d41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '.version_select at 0x7f14961404c0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:40.790579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:40.791185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:40.797697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:40.798138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:40.798899 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:40.799514 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:40.814156 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-09e41dd3-3c77-4e0a-9475-405691820d41 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054702730" status: 202 len: 0 microversion: 2.1 time: 0.106924 Jun 24 08:25:40.815229 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 467/930] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 24 08:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054702730 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:25:40.903535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3345cc7b11246358bb1f5babd054e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc30155e50104560b2cd8d95f3e534a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:40.917409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8c31cb4f-d51b-42fa-8c48-f760437e4dbc tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 200 len: 1320 microversion: 2.1 time: 0.130904 Jun 24 08:25:40.927490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 464/931] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:40 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 1320 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:25:41.936049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:41.936836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:41.943400 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:41.943758 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:41.945002 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:41.945430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:41.959584 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] HTTP exception thrown: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Request method failure captured: Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a HTTP/1.1 Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNWjOAIkTccBJAacjTCAKNJlfNprknFzf5D-KAfL_x8WIM90dt1CSXvd3iuTmRXREdv3ggU43Rwl2iyzYEoS1mdEzr5yxLRleOMozFZ7Cp2p7YoP4i2H645IihkYiEDCe90NowVOUHRATrBfeaopw-zywrx0pU6ky2gwnSAwPUYajs Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:41.961238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc30155e50104560b2cd8d95f3e534a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}] Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: b3345cc7b11246358bb1f5babd054e60 Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:41.962919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'f15961e4-d216-43b1-91e0-7fddf8d5338a'} Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:41.963783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:41.965101 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:41.966810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Returning 404 to user: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:41.966810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fae4d697-e4f7-45e7-b0e7-39fd416d301c tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 404 len: 111 microversion: 2.1 time: 0.031518 Jun 24 08:25:41.966810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 468/932] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:41 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:41.972944 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-168b088b-7320-424a-969e-3a1a78930f02 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '.version_select at 0x7f149634b1f0>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:42.113514 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-168b088b-7320-424a-969e-3a1a78930f02 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-3355311" status: 202 len: 0 microversion: 2.1 time: 0.144566 Jun 24 08:25:42.114203 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 465/933] 10.222.0.42 () {58 vars in 1211 bytes} [Fri Jun 24 08:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-3355311 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:25:43.113616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:43.114190 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:43.119858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:43.120332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:43.121071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:43.121494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:43.136294 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 HTTP/1.1 Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:43.138857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.140600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '24daa898-2b62-4e1e-8c27-3e451302f4c1'} Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:43.141396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.142624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.144096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:43.144096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2c01805f-3ac2-4c8f-a87e-d810d989c01a tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 404 len: 111 microversion: 2.1 time: 0.030375 Jun 24 08:25:43.144096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 469/934] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:43 2022] DELETE /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:43.158472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:43.159087 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 24daa898-2b62-4e1e-8c27-3e451302f4c1] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:43.166509 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:43.166958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:43.167709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:43.168143 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:43.181315 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 HTTP/1.1 Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:43.182940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.185421 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '24daa898-2b62-4e1e-8c27-3e451302f4c1'} Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:43.186378 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. Jun 24 08:25:43.187934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:43.189268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance 24daa898-2b62-4e1e-8c27-3e451302f4c1 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:43.189268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7cf5c3e4-0e6b-4ccd-90de-c3ee73cf7135 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1" status: 404 len: 111 microversion: 2.1 time: 0.030114 Jun 24 08:25:43.189268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 466/935] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:43 2022] GET /compute/v2.1/servers/24daa898-2b62-4e1e-8c27-3e451302f4c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:44.572677 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:44.575000 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:44.579941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.580427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.581182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.581613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.595981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 HTTP/1.1 Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:44.597573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.599143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '2cb69e2f-11a1-4083-9b37-e10f77cc3ce0'} Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:44.600014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.601488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.602851 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:44.602851 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3b2efc80-b7c0-419b-a83a-3e9276f102ba tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 404 len: 111 microversion: 2.1 time: 0.030226 Jun 24 08:25:44.602851 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 470/936] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:44 2022] DELETE /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:44.607705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:44.609024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:44.615550 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.615992 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.616785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.617211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.635031 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 HTTP/1.1 Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:44.636583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.638234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '2cb69e2f-11a1-4083-9b37-e10f77cc3ce0'} Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:44.639042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. Jun 24 08:25:44.641553 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.643501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance 2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:44.643501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1db93ca6-5b5e-4004-abd3-a3e0cecf6d69 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0" status: 404 len: 111 microversion: 2.1 time: 0.034224 Jun 24 08:25:44.643501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 467/937] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:44 2022] GET /compute/v2.1/servers/2cb69e2f-11a1-4083-9b37-e10f77cc3ce0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:44.652479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:44.652983 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:44.659803 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.660288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.661401 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.661899 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.677551 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae HTTP/1.1 Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:44.679243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.681059 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'c25911a0-62f3-4ceb-8e93-5a492c985fae'} Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:44.685402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.687412 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.688656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:44.688656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e10725c5-a5f2-4c1c-aab8-6e943e5a833b tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 404 len: 111 microversion: 2.1 time: 0.033332 Jun 24 08:25:44.688656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 471/938] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:44 2022] DELETE /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:44.693136 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:44.693752 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: c25911a0-62f3-4ceb-8e93-5a492c985fae] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:44.699984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.700468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.709520 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:44.709964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:44.725830 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae HTTP/1.1 Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:44.727345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.731133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'c25911a0-62f3-4ceb-8e93-5a492c985fae'} Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:44.731956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. Jun 24 08:25:44.733897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:44.734982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance c25911a0-62f3-4ceb-8e93-5a492c985fae could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:44.734982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-febd7930-c83c-4d23-9508-49563b5a6d78 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae" status: 404 len: 111 microversion: 2.1 time: 0.039466 Jun 24 08:25:44.734982 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 468/939] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:44 2022] GET /compute/v2.1/servers/c25911a0-62f3-4ceb-8e93-5a492c985fae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:45.742033 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:45.742749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:45.751496 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:45.752099 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:45.753052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:45.753493 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:45.769587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] HTTP exception thrown: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Request method failure captured: Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a HTTP/1.1 Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNWjOAIkTccBJAacjTCAKNJlfNprknFzf5D-KAfL_x8WIM90dt1CSXvd3iuTmRXREdv3ggU43Rwl2iyzYEoS1mdEzr5yxLRleOMozFZ7Cp2p7YoP4i2H645IihkYiEDCe90NowVOUHRATrBfeaopw-zywrx0pU6ky2gwnSAwPUYajs Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:45.771172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc30155e50104560b2cd8d95f3e534a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}] Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: b3345cc7b11246358bb1f5babd054e60 Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.772612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'f15961e4-d216-43b1-91e0-7fddf8d5338a'} Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:45.773365 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.774667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.775867 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Returning 404 to user: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:45.775867 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e049ea95-b739-47db-bdbb-94806c817af8 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 404 len: 111 microversion: 2.1 time: 0.034419 Jun 24 08:25:45.775867 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 472/940] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:45 2022] DELETE /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:45.783865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:45.784631 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: f15961e4-d216-43b1-91e0-7fddf8d5338a] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:45.792844 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:45.793357 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:45.794279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:45.794849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:45.809727 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] HTTP exception thrown: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Request method failure captured: Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a HTTP/1.1 Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNWjOAIkTccBJAacjTCAKNJlfNprknFzf5D-KAfL_x8WIM90dt1CSXvd3iuTmRXREdv3ggU43Rwl2iyzYEoS1mdEzr5yxLRleOMozFZ7Cp2p7YoP4i2H645IihkYiEDCe90NowVOUHRATrBfeaopw-zywrx0pU6ky2gwnSAwPUYajs Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:45.811393 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc30155e50104560b2cd8d95f3e534a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}] Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: b3345cc7b11246358bb1f5babd054e60 Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.813604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'f15961e4-d216-43b1-91e0-7fddf8d5338a'} Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:45.814397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. Jun 24 08:25:45.815886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:45.824042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Returning 404 to user: Instance f15961e4-d216-43b1-91e0-7fddf8d5338a could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:45.824042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5c2a12b6-c634-413b-a6d0-81a230191c1e tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a" status: 404 len: 111 microversion: 2.1 time: 0.033871 Jun 24 08:25:45.824042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 469/941] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:45 2022] GET /compute/v2.1/servers/f15961e4-d216-43b1-91e0-7fddf8d5338a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:46.019201 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:46.019688 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:46.028661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:46.029109 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:46.031484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:46.032094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:46.046390 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa HTTP/1.1 Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:46.048181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.049703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'a4879e55-2bc5-4df2-b495-a4ba5f0c98fa'} Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:46.050437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.052553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.059832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:46.059832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-02e9ce89-68a6-4827-9578-de2b5d81bae0 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 404 len: 111 microversion: 2.1 time: 0.035679 Jun 24 08:25:46.059832 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 473/942] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:46 2022] DELETE /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:46.066618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:46.067350 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] [instance: a4879e55-2bc5-4df2-b495-a4ba5f0c98fa] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:46.073821 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:46.074367 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:46.075122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:46.075609 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:46.091064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] HTTP exception thrown: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Request method failure captured: Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa HTTP/1.1 Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNVltk4pIsADgRuWfORoyTTcOpAgKNRkxbl55dIJ-UhhFFcDH_NzjiH3ZWmr19WB5YLAzMw9jHLBzoiifypyND9UKiFb1nSMVTzeL5qrxdBE5k0pDp3xCelX23euNa0Tr-Aej7yqeqtwnHVq8ibrCKRPYjNSGbVWch_tjBcpgoZgBc Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:46.093327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a14e04756d06417da712e47759853a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a14e04756d06417da712e47759853a06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a14e04756d06417da712e47759853a06"}]}] Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: a14e04756d06417da712e47759853a06 Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-996271326 Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 633cfb032a0344619f95e72492e85b9c Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeNegativeTest-996271326-project Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.095095 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'a4879e55-2bc5-4df2-b495-a4ba5f0c98fa'} Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:46.099632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. Jun 24 08:25:46.101898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:46.103404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] Returning 404 to user: Instance a4879e55-2bc5-4df2-b495-a4ba5f0c98fa could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:46.103404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-996894df-01e4-406d-ad2c-4beed9bfb3d1 tempest-AttachVolumeNegativeTest-996271326 tempest-AttachVolumeNegativeTest-996271326-project] 10.222.0.42 "GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa" status: 404 len: 111 microversion: 2.1 time: 0.033632 Jun 24 08:25:46.103404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 470/943] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:46 2022] GET /compute/v2.1/servers/a4879e55-2bc5-4df2-b495-a4ba5f0c98fa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:47.107311 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:47.108275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:47.115070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:47.115517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:47.116464 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:47.116902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:47.130910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] HTTP exception thrown: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Request method failure captured: Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 HTTP/1.1 Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNWjOAIkTccBJAacjTCAKNJlfNprknFzf5D-KAfL_x8WIM90dt1CSXvd3iuTmRXREdv3ggU43Rwl2iyzYEoS1mdEzr5yxLRleOMozFZ7Cp2p7YoP4i2H645IihkYiEDCe90NowVOUHRATrBfeaopw-zywrx0pU6ky2gwnSAwPUYajs Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:25:47.132652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc30155e50104560b2cd8d95f3e534a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}] Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: b3345cc7b11246358bb1f5babd054e60 Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.134254 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '47798514-cc6d-44cd-bb83-cc051cd57531'} Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:47.135177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.136547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.137955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Returning 404 to user: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:47.137955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-08ccf1fa-a0e3-448c-a1b0-baa5071b7e14 tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 404 len: 111 microversion: 2.1 time: 0.030619 Jun 24 08:25:47.137955 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 474/944] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:25:47 2022] DELETE /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:47.143272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:47.146566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] [instance: 47798514-cc6d-44cd-bb83-cc051cd57531] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:47.150806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:47.151261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:47.152114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:47.152604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:47.166514 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] HTTP exception thrown: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Request method failure captured: Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 HTTP/1.1 Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNWjOAIkTccBJAacjTCAKNJlfNprknFzf5D-KAfL_x8WIM90dt1CSXvd3iuTmRXREdv3ggU43Rwl2iyzYEoS1mdEzr5yxLRleOMozFZ7Cp2p7YoP4i2H645IihkYiEDCe90NowVOUHRATrBfeaopw-zywrx0pU6ky2gwnSAwPUYajs Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:25:47.173496 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc30155e50104560b2cd8d95f3e534a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc30155e50104560b2cd8d95f3e534a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc30155e50104560b2cd8d95f3e534a6"}]}] Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: dc30155e50104560b2cd8d95f3e534a6 Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718123464 Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: b3345cc7b11246358bb1f5babd054e60 Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeTestJSON-1718123464-project Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.175111 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '47798514-cc6d-44cd-bb83-cc051cd57531'} Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:25:47.176218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. Jun 24 08:25:47.177688 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:25:47.178964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] Returning 404 to user: Instance 47798514-cc6d-44cd-bb83-cc051cd57531 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:25:47.178964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bdcc96eb-53fa-44bf-8dca-8eeb924a8b1d tempest-AttachVolumeTestJSON-1718123464 tempest-AttachVolumeTestJSON-1718123464-project] 10.222.0.42 "GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531" status: 404 len: 111 microversion: 2.1 time: 0.030630 Jun 24 08:25:47.178964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 471/945] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:25:47 2022] GET /compute/v2.1/servers/47798514-cc6d-44cd-bb83-cc051cd57531 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:57.189938 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:57.190900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:57.193096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:57.193745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:57.198399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:57.198833 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:57.199575 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:57.200001 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:57.232430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-85386b03-1eea-4baf-a66a-eafc4872988c tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046343 Jun 24 08:25:57.233146 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 475/946] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 24 08:25:57 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:25:57.290947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:57.291457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:57.294106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:57.294863 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:57.302121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:57.302121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:57.302121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:57.302121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:57.328347 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:25:57.692098 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a2d8b45e-6cdf-4f25-81ff-25daee00befd tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 204 len: 0 microversion: 2.20 time: 0.404688 Jun 24 08:25:57.692736 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 472/947] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 24 08:25:57 2022] DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:25:57.704871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:57.704871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:57.710027 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:57.710517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:57.711280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:57.711714 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:57.869859 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:57.882139 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:57.883643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:57.884839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-975eac08-e1cf-4ecd-8862-68705ce869f0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.187837 Jun 24 08:25:57.885608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 476/948] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:57 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:25:58.904065 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:25:58.904783 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:25:58.911235 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:58.911726 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:58.912618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:25:58.913048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:25:59.048702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:59.056774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:59.058267 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:25:59.059786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-61784764-de48-4420-8668-1adb2407281b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.160153 Jun 24 08:25:59.060380 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 473/949] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:25:58 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:26:00.079003 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:00.079605 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:00.086188 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:00.086630 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:00.087387 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:00.087815 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:00.219566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:00.228524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:00.230012 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:00.231159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-753dfe0c-23b5-40e2-ace0-11d61e495bb9 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.156280 Jun 24 08:26:00.231703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 477/950] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:00 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:26:01.249025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:01.249567 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:01.256278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:01.256729 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:01.257488 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:01.257935 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:01.393167 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:01.401794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:01.403276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:01.404481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cea61a29-a66f-4b6b-b36b-61cbcc348ee7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.159410 Jun 24 08:26:01.405032 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 474/951] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:01 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:26:02.423122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:02.425187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:02.431915 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:02.432394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:02.433154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:02.433842 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:02.584680 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:02.593325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:02.594961 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:02.597084 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2fd862a3-a00f-4419-9c20-0cafd0202a0b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1722 microversion: 2.20 time: 0.177954 Jun 24 08:26:02.597952 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 478/952] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:02 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:26:02.961194 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-9aee92dc-7ffa-431f-8c58-5f392f950a93 req-14014140-9765-4df5-881d-da8535e995f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b5a06-e026-4f8e-af25-d7f2d95c29c4", "name": "network-vif-deleted", "tag": "849207c3-d40c-476a-aae3-4db25b58eb90"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:26:02.970663 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-9aee92dc-7ffa-431f-8c58-5f392f950a93 req-14014140-9765-4df5-881d-da8535e995f7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:02.971804 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-9aee92dc-7ffa-431f-8c58-5f392f950a93 req-14014140-9765-4df5-881d-da8535e995f7 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:02.983651 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-9aee92dc-7ffa-431f-8c58-5f392f950a93 req-14014140-9765-4df5-881d-da8535e995f7 service nova] Creating event network-vif-deleted:849207c3-d40c-476a-aae3-4db25b58eb90 for instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 on hv-cinder-83482 Jun 24 08:26:02.989360 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-9aee92dc-7ffa-431f-8c58-5f392f950a93 req-14014140-9765-4df5-881d-da8535e995f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Jun 24 08:26:02.989962 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 475/953] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:03.619119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:03.619790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:03.626430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:03.626942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:03.628834 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:03.629334 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:03.664565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:03.665248 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:03.666051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lazy-loading 'fault' on Instance uuid e05b5a06-e026-4f8e-af25-d7f2d95c29c4 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:26:03.731441 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:03.741411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:03.743379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6935dece64c14ab28be74275d43f07ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1244423396f45beb9124e6d04e0381b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:03.744773 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b07ed217-d6b4-417c-ab8e-865d5e55c52b tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 200 len: 1371 microversion: 2.20 time: 0.133878 Jun 24 08:26:03.745327 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 479/954] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:03 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:26:04.763424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:04.764107 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:04.771169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:04.771616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:04.772499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:04.772923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:04.788805 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] HTTP exception thrown: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Request method failure captured: Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 HTTP/1.1 Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZnsXslTag3NdYB_EZcwOfaXs-vCzL4DXG04jgroXcB0gAVB8gpaEx4uDDczXonENOi4JVx66U9r2NjbXRm57W9v0ZBoqba-T3IeGYCM-FNfSoVQ10lpPAcHCqpwkhzXH9l9aEuWzAYinPQahxqeOlbi7tHC0lRkUNxQvNMvIWSig Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:26:04.790396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1244423396f45beb9124e6d04e0381b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}] Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 6935dece64c14ab28be74275d43f07ab Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:04.792025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'e05b5a06-e026-4f8e-af25-d7f2d95c29c4'} Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:26:04.793215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:04.794738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:04.796169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Returning 404 to user: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:26:04.796169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cb7bc9c3-f5be-4f23-b537-4037d5b449e0 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 404 len: 111 microversion: 2.20 time: 0.032594 Jun 24 08:26:04.796169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 476/955] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:04 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:26:04.800917 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-04c8839c-42ec-470d-a8bd-a6a84156ea0e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '.version_select at 0x7f14962048b0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:04.863349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-04c8839c-42ec-470d-a8bd-a6a84156ea0e tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104440579" status: 204 len: 0 microversion: 2.20 time: 0.066382 Jun 24 08:26:04.863839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 480/956] 10.222.0.42 () {60 vars in 1258 bytes} [Fri Jun 24 08:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104440579 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 08:26:07.349192 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:07.349721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:07.356075 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:07.356546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:07.357297 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:07.357723 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:07.370959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] HTTP exception thrown: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Request method failure captured: Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 HTTP/1.1 Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZnsXslTag3NdYB_EZcwOfaXs-vCzL4DXG04jgroXcB0gAVB8gpaEx4uDDczXonENOi4JVx66U9r2NjbXRm57W9v0ZBoqba-T3IeGYCM-FNfSoVQ10lpPAcHCqpwkhzXH9l9aEuWzAYinPQahxqeOlbi7tHC0lRkUNxQvNMvIWSig Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:26:07.372523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1244423396f45beb9124e6d04e0381b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}] Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 6935dece64c14ab28be74275d43f07ab Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.374342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'e05b5a06-e026-4f8e-af25-d7f2d95c29c4'} Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:26:07.375206 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.376495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.377718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Returning 404 to user: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:26:07.377718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bc3bd1aa-4840-4291-aac3-3c90c5832493 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 404 len: 111 microversion: 2.20 time: 0.028645 Jun 24 08:26:07.377718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 477/957] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 24 08:26:07 2022] DELETE /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:26:07.383442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:07.384047 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e05b5a06-e026-4f8e-af25-d7f2d95c29c4] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:07.390657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:07.391105 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:07.392027 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:07.392492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:07.406743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] HTTP exception thrown: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Request method failure captured: Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 HTTP/1.1 Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNZnsXslTag3NdYB_EZcwOfaXs-vCzL4DXG04jgroXcB0gAVB8gpaEx4uDDczXonENOi4JVx66U9r2NjbXRm57W9v0ZBoqba-T3IeGYCM-FNfSoVQ10lpPAcHCqpwkhzXH9l9aEuWzAYinPQahxqeOlbi7tHC0lRkUNxQvNMvIWSig Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:26:07.408349 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1244423396f45beb9124e6d04e0381b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}] Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 6935dece64c14ab28be74275d43f07ab Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.410111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'e05b5a06-e026-4f8e-af25-d7f2d95c29c4'} Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:26:07.411135 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. Jun 24 08:26:07.412741 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:07.414233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Returning 404 to user: Instance e05b5a06-e026-4f8e-af25-d7f2d95c29c4 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:26:07.414233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-facd51c5-3fa5-44f4-b359-39be69005f20 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4" status: 404 len: 111 microversion: 2.20 time: 0.031283 Jun 24 08:26:07.414233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 481/958] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:07 2022] GET /compute/v2.1/servers/e05b5a06-e026-4f8e-af25-d7f2d95c29c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:26:08.711865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:08.721999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:08.721999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:08.721999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:08.721999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:08.722382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:08.734388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] HTTP exception thrown: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Request method failure captured: Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 HTTP/1.1 Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXNZnsXslTag3NdYB_EZcwOfaXs-vCzL4DXG04jgroXcB0gAVB8gpaEx4uDDczXonENOi4JVx66U9r2NjbXRm57W9v0ZBoqba-T3IeGYCM-FNfSoVQ10lpPAcHCqpwkhzXH9l9aEuWzAYinPQahxqeOlbi7tHC0lRkUNxQvNMvIWSig Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:26:08.735923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1244423396f45beb9124e6d04e0381b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}] Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 6935dece64c14ab28be74275d43f07ab Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.737598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'e2ac85cf-1104-4227-867c-51b136c5de24'} Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:26:08.739260 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.745680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.747270 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Returning 404 to user: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:26:08.747270 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e07abc05-327f-4306-9303-bb36823ead84 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 404 len: 111 microversion: 2.20 time: 0.029984 Jun 24 08:26:08.747270 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 478/959] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 24 08:26:08 2022] DELETE /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:26:08.751418 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:08.752050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] [instance: e2ac85cf-1104-4227-867c-51b136c5de24] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:08.758700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:08.759138 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:08.759893 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:08.760381 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:08.774330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] HTTP exception thrown: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Request method failure captured: Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 HTTP/1.1 Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXNZnsXslTag3NdYB_EZcwOfaXs-vCzL4DXG04jgroXcB0gAVB8gpaEx4uDDczXonENOi4JVx66U9r2NjbXRm57W9v0ZBoqba-T3IeGYCM-FNfSoVQ10lpPAcHCqpwkhzXH9l9aEuWzAYinPQahxqeOlbi7tHC0lRkUNxQvNMvIWSig Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:26:08.775827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1244423396f45beb9124e6d04e0381b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1244423396f45beb9124e6d04e0381b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1244423396f45beb9124e6d04e0381b"}]}] Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: e1244423396f45beb9124e6d04e0381b Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614815623 Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 6935dece64c14ab28be74275d43f07ab Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614815623-project Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.777626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'e2ac85cf-1104-4227-867c-51b136c5de24'} Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:26:08.778596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. Jun 24 08:26:08.779855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:26:08.781078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] Returning 404 to user: Instance e2ac85cf-1104-4227-867c-51b136c5de24 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:26:08.781078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-49c1a2bb-26fb-4377-8194-e7a915e18cb7 tempest-AttachVolumeShelveTestJSON-1614815623 tempest-AttachVolumeShelveTestJSON-1614815623-project] 10.222.0.42 "GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24" status: 404 len: 111 microversion: 2.20 time: 0.029675 Jun 24 08:26:08.781078 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 482/960] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 24 08:26:08 2022] GET /compute/v2.1/servers/e2ac85cf-1104-4227-867c-51b136c5de24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:26:15.229664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f7f18ecf-2ab4-4348-9a92-3f92ba93c9b7 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Action: 'create', calling method: .version_select at 0x7f1497799550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-618619995", "metadata": {"Type": "work"}}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:26:15.905037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f7f18ecf-2ab4-4348-9a92-3f92ba93c9b7 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.787652 Jun 24 08:26:15.905726 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 479/961] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 24 08:26:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 08:26:15.917647 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7299a0ce-0c2f-4206-9004-067e5c394390 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f1496098d30>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:15.971579 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7299a0ce-0c2f-4206-9004-067e5c394390 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 352 microversion: 2.1 time: 0.058032 Jun 24 08:26:15.972241 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 483/962] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:15 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:16.985472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3a55ffac-efdf-408f-aa3c-0e78154acf74 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f149634bc10>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:17.038358 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3a55ffac-efdf-408f-aa3c-0e78154acf74 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 352 microversion: 2.1 time: 0.057340 Jun 24 08:26:17.038926 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 480/963] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:16 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:18.057341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bbfb62f1-3090-4389-a755-4b6bcf09de92 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f14961041f0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:18.104701 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bbfb62f1-3090-4389-a755-4b6bcf09de92 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 352 microversion: 2.1 time: 0.051470 Jun 24 08:26:18.105410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 484/964] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:18 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:19.119652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:19.119652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:19.120848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d798d6d2-2dbf-401e-aa97-9084699602fe tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f14963cb160>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:19.711564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d798d6d2-2dbf-401e-aa97-9084699602fe tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 353 microversion: 2.1 time: 0.598252 Jun 24 08:26:19.712165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 481/965] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:19 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 353 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:26:19.719888 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:19.723532 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=36 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:19.725403 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d723416b-9e3c-45f1-89e1-64008a26fac9 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f14962cd1f0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:19.791479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d723416b-9e3c-45f1-89e1-64008a26fac9 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 353 microversion: 2.1 time: 0.072161 Jun 24 08:26:19.792041 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 485/966] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:19 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:19.813037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-459ab850-a28a-477b-8a0f-d397febd0ecd tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f1496654550>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:20.109649 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-459ab850-a28a-477b-8a0f-d397febd0ecd tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 202 len: 0 microversion: 2.1 time: 0.300658 Jun 24 08:26:20.110215 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 482/967] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 24 08:26:19 2022] DELETE /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:26:20.119207 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f143327e-79eb-4a19-80a2-253b1648c2e3 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f1496183b80>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:20.168905 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f143327e-79eb-4a19-80a2-253b1648c2e3 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 352 microversion: 2.1 time: 0.053372 Jun 24 08:26:20.169482 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 486/968] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:20 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:21.184255 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bb008939-b33e-4ff3-9293-2adeccb23d53 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f1496220670>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:21.360448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bb008939-b33e-4ff3-9293-2adeccb23d53 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 352 microversion: 2.1 time: 0.182731 Jun 24 08:26:21.360956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 483/969] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:21 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:22.373523 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-53f41808-d9ed-447b-89dc-64729117f8dc tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f14960985e0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:22.420724 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-53f41808-d9ed-447b-89dc-64729117f8dc tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 200 len: 352 microversion: 2.1 time: 0.050884 Jun 24 08:26:22.426697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 487/970] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:22 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:23.433632 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3fce1ddc-b4c7-4ffa-99ec-3a4286680139 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Calling method '.version_select at 0x7f14963cb790>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:23.462535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-3fce1ddc-b4c7-4ffa-99ec-3a4286680139 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] HTTP exception thrown: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3fce1ddc-b4c7-4ffa-99ec-3a4286680139 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Request method failure captured: Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 HTTP/1.1 Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXUnCX1Npzelur1eHk9aryRWoF9ijn6uGYBYeOpze_-y1lgdbzsF09VUOG2J9LB0VFXpGXGLc9gWSIOOU_Lp0gEJVK9NVig6dLq3NYVDDnT4Ek9JsZdUHx5o0nyuzewDZP01vpmxVQgM-J6ddxrQOmBIySaanFHViizruuCsmEXO_YE Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 2c2e4caa55e643e09f0d5c36e5fae9a4 Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-VolumesGetTestJSON-1810342987 Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:26:23.464499 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2c2e4caa55e643e09f0d5c36e5fae9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2c2e4caa55e643e09f0d5c36e5fae9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2c2e4caa55e643e09f0d5c36e5fae9a4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2c2e4caa55e643e09f0d5c36e5fae9a4"}]}] Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-VolumesGetTestJSON-1810342987 Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 2c2e4caa55e643e09f0d5c36e5fae9a4 Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-VolumesGetTestJSON-1810342987 Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-VolumesGetTestJSON-1810342987-project Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 55f125e35cc54fe7818789e2f553e0ad Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-VolumesGetTestJSON-1810342987-project Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': 'f1c65034-df8f-4869-a332-b4fb1562a465'} Jun 24 08:26:23.466209 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. (HTTP 404) (Request-ID: req-e2393156-6407-4d87-b983-2bc54f17fccd) Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:23.467195 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:26:23.468933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:26:23.470700 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3fce1ddc-b4c7-4ffa-99ec-3a4286680139 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] Returning 404 to user: Volume f1c65034-df8f-4869-a332-b4fb1562a465 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3fce1ddc-b4c7-4ffa-99ec-3a4286680139 tempest-VolumesGetTestJSON-1810342987 tempest-VolumesGetTestJSON-1810342987-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465" status: 404 len: 109 microversion: 2.1 time: 0.036570 Jun 24 08:26:23.472186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 484/971] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 24 08:26:23 2022] GET /compute/v2.1/os-volumes/f1c65034-df8f-4869-a332-b4fb1562a465 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:26:24.543964 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1899373077", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1900007784", "security_groups": [{"name": "tempest-secgroup-smoke-1452156496"}], "block_device_mapping_v2": [{"uuid": "9429b7b7-f0d0-429d-bafb-d829db3cf608", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b69c08d-6a46-414d-bcd2-12cdadfd6edc"}]}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:26:24.681638 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] validate_networks() for [('7b69c08d-6a46-414d-bcd2-12cdadfd6edc', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:26:25.075563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:26:25.076070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:26:25.076657 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:26:25.077140 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:26:25.077597 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:26:25.088121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:25.090117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:25.090117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:25.090117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:25.107040 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:26:25.110921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Getting quotas for user 01fe8c57517d4ca5958ec13139aa2b74 and project 9170777eb80e46bd9d8ea3a576a9678c. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:26:25.169698 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:26:25.171783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9429b7b7-f0d0-429d-bafb-d829db3cf608',volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:26:25.715821 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-158f93fb-3367-49a1-a3c0-b285a08253fc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.176840 Jun 24 08:26:25.717395 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 488/972] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:26:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:26:25.737622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9dba96f8-1214-496f-9acb-4b675cd29111 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:25.738579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9dba96f8-1214-496f-9acb-4b675cd29111 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:25.827600 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9dba96f8-1214-496f-9acb-4b675cd29111 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:25.835975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9dba96f8-1214-496f-9acb-4b675cd29111 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1095 microversion: 2.1 time: 0.104631 Jun 24 08:26:25.836568 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 485/973] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:25 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:26:26.852477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:26.853090 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:26.859674 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:26.865114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:26.865114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:26.865114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:26.923858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:26.933612 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4cbed593-906b-4aae-a518-36b72211003f tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1145 microversion: 2.1 time: 0.084880 Jun 24 08:26:26.934611 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 489/974] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:26 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:27.951388 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:27.951996 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:27.959386 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:27.959912 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:27.960710 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:27.961175 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:28.024768 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:28.033397 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-09ab4b41-1570-469f-b109-fe87bec35add tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1145 microversion: 2.1 time: 0.085066 Jun 24 08:26:28.034071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 486/975] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:27 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:29.052142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:29.052765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:29.058622 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:29.059320 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:29.060082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:29.060515 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:29.121883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:29.129467 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-47177be2-02e9-4629-90ae-b7dcc7116e39 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1193 microversion: 2.1 time: 0.082459 Jun 24 08:26:29.130023 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 490/976] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:29 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:30.146650 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:30.147305 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:30.153858 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:30.154311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:30.155069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:30.155507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:30.216584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:30.224570 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-21f5900c-08d3-4fc9-bc36-14f1a95e92e8 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1193 microversion: 2.1 time: 0.082472 Jun 24 08:26:30.225131 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 487/977] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:30 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:31.241797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:31.242404 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:31.248321 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:31.248771 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:31.249524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:31.249959 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:31.313458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:31.321865 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-14c520ab-9269-49a9-b550-244a690e9792 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1193 microversion: 2.1 time: 0.084488 Jun 24 08:26:31.322459 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 491/978] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:31 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:26:32.338550 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:32.339165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:32.345711 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:32.346277 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:32.347087 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:32.347619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:32.411039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:32.418437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3a4a59f6-ef15-42e7-9b11-893e31395cad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1211 microversion: 2.1 time: 0.083819 Jun 24 08:26:32.419086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 488/979] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:32 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:33.435854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:33.436554 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:33.444049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:33.444049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:33.444343 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:33.444700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:33.587738 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:33.593038 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cff3ce66-3718-4da1-9d44-1f420babcfea tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1279 microversion: 2.1 time: 0.161298 Jun 24 08:26:33.593599 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 492/980] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:33 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:33.959417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-76f9281b-e696-4a1a-bccb-c617f72662be req-7d401646-0daf-4c48-9b35-dbe555a2c6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261fe17-2ca6-4028-8298-7b1e902a6bba", "tag": "eb456bc9-e755-4237-b02c-9c8369b8fd4e"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:26:33.971775 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-76f9281b-e696-4a1a-bccb-c617f72662be req-7d401646-0daf-4c48-9b35-dbe555a2c6fd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:33.976487 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-76f9281b-e696-4a1a-bccb-c617f72662be req-7d401646-0daf-4c48-9b35-dbe555a2c6fd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:33.987768 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-76f9281b-e696-4a1a-bccb-c617f72662be req-7d401646-0daf-4c48-9b35-dbe555a2c6fd service nova] Creating event network-changed:eb456bc9-e755-4237-b02c-9c8369b8fd4e for instance a261fe17-2ca6-4028-8298-7b1e902a6bba on hv-cinder-83482 Jun 24 08:26:33.993743 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-76f9281b-e696-4a1a-bccb-c617f72662be req-7d401646-0daf-4c48-9b35-dbe555a2c6fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040298 Jun 24 08:26:33.998184 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 489/981] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:34.609944 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:34.610549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:34.617325 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:34.617765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:34.618518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:34.618946 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:34.750780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:34.758824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cc64a7ed-73d1-48e2-8a43-204b5624c078 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1279 microversion: 2.1 time: 0.152739 Jun 24 08:26:34.759383 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 493/982] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:34 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:35.776734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:35.777427 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:35.783988 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:35.784468 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:35.785290 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:35.785721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:35.833187 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:35.914083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:35.921450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bc81b55e-8861-46c2-a7c4-f64039583058 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1279 microversion: 2.1 time: 0.148905 Jun 24 08:26:35.921999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 490/983] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:35 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:36.939118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:36.939739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:36.941596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:36.942332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=6 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:36.947301 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:36.947754 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:36.948607 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:36.949052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:37.107281 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:37.115128 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c7b30fea-4a89-411b-81ec-3481233dfd7e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1279 microversion: 2.1 time: 0.179805 Jun 24 08:26:37.115715 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 494/984] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:36 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:38.132016 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:38.132669 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:38.139002 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:38.139448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:38.140234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:38.140738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:38.290252 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:38.292351 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-53a5f502-b749-4cec-8458-81532f22c31b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.164207 Jun 24 08:26:38.292913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 491/985] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:38 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:39.309083 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:39.309698 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:39.316256 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:39.316704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:39.317477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:39.317954 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:39.448143 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:39.455485 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f76c78c3-19b0-422f-b570-6c23770678ad tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.150532 Jun 24 08:26:39.456043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 495/986] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:39 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:40.472604 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:40.473320 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:40.481010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:40.481456 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:40.482302 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:40.482729 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:40.622796 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:40.630696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-756bba23-c6f5-449b-b082-6ffeb498f4a1 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.161828 Jun 24 08:26:40.635648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 492/987] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:40 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:41.648046 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:41.648692 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:41.654738 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:41.655185 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:41.658505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:41.658505 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:41.863678 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:41.873036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-aaf302f2-4ac7-41db-8a31-315a1772b030 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.229720 Jun 24 08:26:41.873566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 496/988] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:41 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:42.893147 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:42.893812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:42.901596 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:42.902030 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:42.902806 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:42.903235 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:43.043236 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:43.055088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dded57c5-3816-4ff7-9d6d-749b7b2da2d0 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.165663 Jun 24 08:26:43.055669 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 493/989] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:42 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:44.072796 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:44.073393 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:44.079217 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:44.079760 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:44.080540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:44.084601 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:44.216261 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:44.230061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bb2d2df9-252c-4db2-9574-f15fd3f302d6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.161770 Jun 24 08:26:44.230939 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 497/990] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:44 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:45.246918 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:45.247601 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:45.253878 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:45.254422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:45.255236 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:45.256696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:45.395635 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:45.404276 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ea68c122-049d-4d9b-869d-1765ff0d0da9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.161237 Jun 24 08:26:45.404838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 494/991] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:45 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:46.421114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:46.421723 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:46.427836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:46.428362 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:46.429142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:46.429564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:46.562524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:46.570414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8d3e3ea7-b2a2-4ec4-bf69-2605d3005c0d tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.153051 Jun 24 08:26:46.570986 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 498/992] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:46 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:47.588576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:47.589324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:47.595869 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:47.596348 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:47.597307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:47.597910 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:47.735494 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:47.743281 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-51c9154b-7832-456d-b00d-8785da7d508e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.160193 Jun 24 08:26:47.743829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 495/993] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:47 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:48.760707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:48.761348 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:48.767704 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:48.768147 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:48.768942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:48.769368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:48.901292 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:48.909246 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-fc74bc18-250b-4091-8a57-2e3b91801f18 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.154354 Jun 24 08:26:48.909815 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 499/994] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:48 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:49.926001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:49.926601 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:49.929488 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=25 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:49.934436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:49.934876 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:49.935621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:49.936043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:49.939887 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=57 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:50.072765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:50.080133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c92227b4-d818-447d-8259-ffc60ad10415 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.157965 Jun 24 08:26:50.080759 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 496/995] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:49 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:51.102112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:51.102112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:51.105040 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:51.105663 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:51.106440 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:51.106863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:51.111153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=69 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:51.246450 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:51.253651 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-06b2fa73-547c-42ab-b26e-9babae45b26b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.160010 Jun 24 08:26:51.254202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 500/996] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:51 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:52.271642 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:52.273144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:52.279831 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:52.280318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:52.288243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:52.288243 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:52.419898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:52.428310 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3eb32156-17c6-458d-bcd3-2973a07cc27c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.161152 Jun 24 08:26:52.429148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 497/997] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:52 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:52.737643 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-713955ea-eb57-4704-b7b9-ebaf2b2428a6 req-c8d0f750-d60d-4aac-a2e4-5b38cb45b26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261fe17-2ca6-4028-8298-7b1e902a6bba", "name": "network-vif-plugged", "status": "completed", "tag": "eb456bc9-e755-4237-b02c-9c8369b8fd4e"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:26:52.741841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:52.747093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-713955ea-eb57-4704-b7b9-ebaf2b2428a6 req-c8d0f750-d60d-4aac-a2e4-5b38cb45b26b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:52.747518 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-713955ea-eb57-4704-b7b9-ebaf2b2428a6 req-c8d0f750-d60d-4aac-a2e4-5b38cb45b26b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:52.759702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-713955ea-eb57-4704-b7b9-ebaf2b2428a6 req-c8d0f750-d60d-4aac-a2e4-5b38cb45b26b service nova] Creating event network-vif-plugged:eb456bc9-e755-4237-b02c-9c8369b8fd4e for instance a261fe17-2ca6-4028-8298-7b1e902a6bba on hv-cinder-83482 Jun 24 08:26:52.765377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-713955ea-eb57-4704-b7b9-ebaf2b2428a6 req-c8d0f750-d60d-4aac-a2e4-5b38cb45b26b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030711 Jun 24 08:26:52.765377 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 501/998] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:26:53.446392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:53.447069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:53.453413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:53.457324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:53.457324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:53.457324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:53.829965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:53.838654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-20ad7fd3-9537-4b5a-bfe6-848ffff43e41 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1267 microversion: 2.1 time: 0.396904 Jun 24 08:26:53.839284 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 498/999] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:53 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1267 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:54.860949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:54.861647 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:54.869581 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:54.870019 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:54.870776 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:54.871201 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:55.007461 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:55.015302 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0fa228f4-b55d-4207-9a23-af84fb522594 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1454 microversion: 2.1 time: 0.163841 Jun 24 08:26:55.015941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 502/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:54 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:55.032555 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:26:55.033186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:26:55.039735 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:55.040236 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:55.041007 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:55.041447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:55.174920 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:26:55.183035 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5ef6a3c6-baa6-45ca-9718-bb5d7a6391ce tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1454 microversion: 2.1 time: 0.154278 Jun 24 08:26:55.183424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 499/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:26:55 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:26:57.801739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-97fb1c65-7635-40f2-8dd9-30950d71d9d0 req-c9807d97-275d-4c21-b3f7-991db5be5686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261fe17-2ca6-4028-8298-7b1e902a6bba", "tag": "eb456bc9-e755-4237-b02c-9c8369b8fd4e"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:26:57.809970 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-97fb1c65-7635-40f2-8dd9-30950d71d9d0 req-c9807d97-275d-4c21-b3f7-991db5be5686 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:26:57.810753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-97fb1c65-7635-40f2-8dd9-30950d71d9d0 req-c9807d97-275d-4c21-b3f7-991db5be5686 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:26:57.822184 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-97fb1c65-7635-40f2-8dd9-30950d71d9d0 req-c9807d97-275d-4c21-b3f7-991db5be5686 service nova] Creating event network-changed:eb456bc9-e755-4237-b02c-9c8369b8fd4e for instance a261fe17-2ca6-4028-8298-7b1e902a6bba on hv-cinder-83482 Jun 24 08:26:57.828417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-97fb1c65-7635-40f2-8dd9-30950d71d9d0 req-c9807d97-275d-4c21-b3f7-991db5be5686 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029399 Jun 24 08:26:57.828417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 503/1002] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:27:28.701416 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=7 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:28.702163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=23 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:28.706027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-823260766", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "networks": [{"uuid": "f483dddf-c01c-483a-8f77-8afd8701c08c"}]}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:27:28.759189 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] validate_networks() for [('f483dddf-c01c-483a-8f77-8afd8701c08c', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:27:29.108877 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:27:29.109294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:27:29.109760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:27:29.110191 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:27:29.110625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:27:29.120508 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:29.120970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:29.122342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:29.123629 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:29.142548 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Getting quotas for project 7e1a997836914066a8aa2ebe98396d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:27:29.149014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Getting quotas for user ad7359641c2f42f5887153ce08bad096 and project 7e1a997836914066a8aa2ebe98396d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:27:29.158446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:27:29.160711 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:27:29.287867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e5f955d5-518e-41d4-a549-298349309f58 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588125 Jun 24 08:27:29.288564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 500/1003] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:27:29.295786 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=5 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:29.296562 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=15 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:29.300488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0c91df73-3856-415a-b261-67fd5882c2bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:29.301176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0c91df73-3856-415a-b261-67fd5882c2bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:29.355045 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0c91df73-3856-415a-b261-67fd5882c2bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:29.363394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0c91df73-3856-415a-b261-67fd5882c2bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1213 microversion: 2.1 time: 0.068696 Jun 24 08:27:29.363971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 504/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:29 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:30.380697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:30.381347 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:30.393409 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:30.393916 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:30.394808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:30.395323 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:30.466705 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:30.474503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7b181c9f-a41e-4a2f-a9b0-ec55734ef6c6 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1217 microversion: 2.1 time: 0.097644 Jun 24 08:27:30.475135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 501/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:30 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:31.496293 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:31.496986 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:31.503272 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:31.503749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:31.504522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:31.504957 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:31.566695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:31.574208 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6ab90e14-0e9a-48b5-8e59-6bb7107c0053 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1217 microversion: 2.1 time: 0.081880 Jun 24 08:27:31.574762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 505/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:31 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:32.591649 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:32.592371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:32.602879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:32.606376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:32.606376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:32.606376 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:32.673956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:32.681363 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-03208335-d1c0-40d7-8b48-6c0072d72b75 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1265 microversion: 2.1 time: 0.093889 Jun 24 08:27:32.681971 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 502/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:32 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:33.699216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:33.699833 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:33.708122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:33.709112 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:33.709371 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:33.709801 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:33.848375 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:33.855906 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-32fc4166-2358-4f76-a7e8-5b273aa80c62 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.160771 Jun 24 08:27:33.857224 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 506/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:33 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:34.654310 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-7f863c61-c5c4-49ce-b685-11f0e2aa7957 req-27cf394b-13fc-4d7d-8476-870873cd1f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b", "tag": "ba84dea1-5f3c-4a69-a675-498b016e4eba"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:27:34.665528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7f863c61-c5c4-49ce-b685-11f0e2aa7957 req-27cf394b-13fc-4d7d-8476-870873cd1f41 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:34.666098 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7f863c61-c5c4-49ce-b685-11f0e2aa7957 req-27cf394b-13fc-4d7d-8476-870873cd1f41 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:34.681318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-7f863c61-c5c4-49ce-b685-11f0e2aa7957 req-27cf394b-13fc-4d7d-8476-870873cd1f41 service nova] Creating event network-changed:ba84dea1-5f3c-4a69-a675-498b016e4eba for instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b on hv-cinder-83482 Jun 24 08:27:34.690879 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-7f863c61-c5c4-49ce-b685-11f0e2aa7957 req-27cf394b-13fc-4d7d-8476-870873cd1f41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040252 Jun 24 08:27:34.691793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 503/1009] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:27:34.873732 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:34.874317 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:34.880287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:34.880765 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:34.881567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:34.881996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:35.028515 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:35.037108 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a62e09ae-0aa1-48a0-8c5c-8231a7fbbd9c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.167222 Jun 24 08:27:35.037685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 507/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:34 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:36.055047 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:36.055654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:36.062463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:36.062904 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:36.063648 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:36.064077 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:36.197734 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:36.206948 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-66cf4fde-5274-47cf-92d3-2d847be4ae49 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.156491 Jun 24 08:27:36.207578 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 504/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:36 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:37.224883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:37.225489 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:37.231363 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:37.232442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:37.233233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:37.233667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:37.367277 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:37.375165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-af4aa20b-7221-4eaf-92d2-9a1348b7d880 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.154200 Jun 24 08:27:37.375717 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 508/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:37 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:38.391998 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:38.392636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:38.399130 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:38.399580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:38.400375 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:38.400813 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:38.526408 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:38.533953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a97ef378-074b-4049-aa60-74a0d27b127a tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.145975 Jun 24 08:27:38.534506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 505/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:38 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:39.550571 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:39.551194 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:39.553087 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:39.557900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:39.558340 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:39.559094 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:39.559772 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:39.691957 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:39.699469 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-28713f13-9425-4b11-b785-333e6b750dc0 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.152706 Jun 24 08:27:39.700032 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 509/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:39 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:40.718760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:40.719368 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:40.721343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:40.722014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:40.727300 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:40.727750 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:40.728549 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:40.728985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:40.867502 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:40.874785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-66599e7a-9691-4b05-afa2-dfc580d6824d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.160981 Jun 24 08:27:40.875338 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 506/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:40 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:41.894626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:41.895235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:41.901268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:41.901759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:41.902516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:41.902949 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:42.037998 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:42.045728 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-7d8ae4b4-9d3d-4da9-924e-5798c58971e8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.155060 Jun 24 08:27:42.046288 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 510/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:41 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:43.062959 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:43.063669 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:43.064280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-47779110-5f29-49b7-8fff-475a80faaed7 req-ee2477a8-ebad-44bc-abdf-a4d4b77e10b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b", "name": "network-vif-plugged", "status": "completed", "tag": "ba84dea1-5f3c-4a69-a675-498b016e4eba"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:27:43.072407 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:43.072778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-47779110-5f29-49b7-8fff-475a80faaed7 req-ee2477a8-ebad-44bc-abdf-a4d4b77e10b8 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:43.075132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:43.075267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-47779110-5f29-49b7-8fff-475a80faaed7 req-ee2477a8-ebad-44bc-abdf-a4d4b77e10b8 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:43.075371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:43.075371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:43.085516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-47779110-5f29-49b7-8fff-475a80faaed7 req-ee2477a8-ebad-44bc-abdf-a4d4b77e10b8 service nova] Creating event network-vif-plugged:ba84dea1-5f3c-4a69-a675-498b016e4eba for instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b on hv-cinder-83482 Jun 24 08:27:43.090898 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-47779110-5f29-49b7-8fff-475a80faaed7 req-ee2477a8-ebad-44bc-abdf-a4d4b77e10b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031772 Jun 24 08:27:43.091632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 511/1017] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:27:43.215091 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:43.223412 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ace80220-92e6-4203-8e87-5f725520d71d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.165144 Jun 24 08:27:43.223977 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 507/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:43 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:44.240848 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:44.241574 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:44.248403 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:44.248924 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:44.249863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:44.250297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:44.381696 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:44.390903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c0f0c7be-479d-4e69-84c1-20a9a04ca7ee tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1313 microversion: 2.1 time: 0.152572 Jun 24 08:27:44.390903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 512/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:44 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:45.406413 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:45.407044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:45.413200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:45.413640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:45.414382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:45.414811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:45.546689 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:45.554583 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4123feb8-180c-4d5e-a65f-097771456da8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1497 microversion: 2.1 time: 0.152544 Jun 24 08:27:45.555096 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 508/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:45 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:46.662703 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:46.663250 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:46.669308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:46.669758 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:46.671178 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:46.671656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:46.697442 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:27:46.943810 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-814257b9-22fb-4e3c-98ed-8ca154be3338 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 204 len: 0 microversion: 2.1 time: 0.284536 Jun 24 08:27:46.944533 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 513/1021] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:27:46 2022] DELETE /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:27:46.952881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:46.953523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:46.959923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:46.960412 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:46.961164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:46.961596 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:47.112862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:47.130420 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7cc568b7-ceae-4e19-95c3-44d6decb74eb tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1503 microversion: 2.1 time: 0.181473 Jun 24 08:27:47.131013 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 509/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:46 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:48.147919 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:48.148636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:48.154496 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:48.154939 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:48.155699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:48.156129 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:48.298182 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:48.306693 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-06c8ea2f-2963-430b-b380-a248aeae21da tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1503 microversion: 2.1 time: 0.162860 Jun 24 08:27:48.307261 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 514/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:48 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:49.325471 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:49.326113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:49.332644 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:49.333093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:49.333855 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:49.334293 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:49.474940 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:49.476168 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-af383f43-2808-43f9-8443-fe6db715d9de tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1503 microversion: 2.1 time: 0.154623 Jun 24 08:27:49.476760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 510/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:49 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:49.545127 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-5d5c92b3-755e-4a57-b5d0-1d34c38b7d4c req-616b7cbc-6248-4980-8e06-8b5857d59c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b", "name": "network-vif-deleted", "tag": "ba84dea1-5f3c-4a69-a675-498b016e4eba"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:27:49.554084 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-5d5c92b3-755e-4a57-b5d0-1d34c38b7d4c req-616b7cbc-6248-4980-8e06-8b5857d59c26 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:49.554462 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-5d5c92b3-755e-4a57-b5d0-1d34c38b7d4c req-616b7cbc-6248-4980-8e06-8b5857d59c26 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:49.568499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-5d5c92b3-755e-4a57-b5d0-1d34c38b7d4c req-616b7cbc-6248-4980-8e06-8b5857d59c26 service nova] Creating event network-vif-deleted:ba84dea1-5f3c-4a69-a675-498b016e4eba for instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b on hv-cinder-83482 Jun 24 08:27:49.573792 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-5d5c92b3-755e-4a57-b5d0-1d34c38b7d4c req-616b7cbc-6248-4980-8e06-8b5857d59c26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032252 Jun 24 08:27:49.574834 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 515/1025] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:27:50.495103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:50.495706 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:50.504069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:50.504606 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:50.505382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:50.505958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:50.540084 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:50.540557 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:50.542574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lazy-loading 'fault' on Instance uuid 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:27:50.589245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:50.597896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cd04a869-b91f-4daa-80ee-58e6a84823ed tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 200 len: 1303 microversion: 2.1 time: 0.107185 Jun 24 08:27:50.598476 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 511/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:50 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:27:51.617981 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:51.618669 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:51.624800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:51.625235 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:51.625995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:51.626421 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:51.639198 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] HTTP exception thrown: Instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b could not be found. Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Request method failure captured: Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b HTTP/1.1 Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXVugF6SNi5regzw8Ih-zWVRdLHGv9Bg8KSKL05K6NoQrvufg-GOLH9UigFwcGc-NENRk0bgo5KW6cN1KVoGgxI7F5_lozL44InN8atI60SRuSA-N9vosqewDR0yggT6ichyG3pYiyQP8HkSRUUCYsJl_F4JslBU8zvENsUnRGL_FhU Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 7e1a997836914066a8aa2ebe98396d1b Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-VolumesActionsTest-618077003 Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:27:51.640875 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e1a997836914066a8aa2ebe98396d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e1a997836914066a8aa2ebe98396d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e1a997836914066a8aa2ebe98396d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e1a997836914066a8aa2ebe98396d1b"}]}] Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-VolumesActionsTest-618077003 Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 7e1a997836914066a8aa2ebe98396d1b Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-VolumesActionsTest-618077003 Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-VolumesActionsTest-618077003-project Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: ad7359641c2f42f5887153ce08bad096 Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-VolumesActionsTest-618077003-project Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b could not be found. Jun 24 08:27:51.642709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b'} Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b could not be found. Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:27:51.643691 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b could not be found. Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b could not be found. Jun 24 08:27:51.645353 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:27:51.646933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Returning 404 to user: Instance 6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:27:51.646933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-154a5abd-cb2c-42c2-98ba-b0615d881503 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b" status: 404 len: 111 microversion: 2.1 time: 0.028804 Jun 24 08:27:51.646933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 516/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:51 2022] GET /compute/v2.1/servers/6ca88cfe-ff9b-4bf6-9174-68c1bd17e96b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:27:51.748450 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1381933410", "imageRef": "1f2abcd5-e5f5-4a8b-888c-316a85c23d1c", "flavorRef": "452", "networks": [{"uuid": "f483dddf-c01c-483a-8f77-8afd8701c08c"}]}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:27:51.806289 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] validate_networks() for [('f483dddf-c01c-483a-8f77-8afd8701c08c', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:27:52.159114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:27:52.159544 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:27:52.160254 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:27:52.160654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:27:52.161073 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:27:52.171165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:52.171612 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:52.172535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:52.173230 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:52.190552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Getting quotas for project 7e1a997836914066a8aa2ebe98396d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:27:52.194489 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Getting quotas for user ad7359641c2f42f5887153ce08bad096 and project 7e1a997836914066a8aa2ebe98396d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:27:52.207142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:27:52.209503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f2abcd5-e5f5-4a8b-888c-316a85c23d1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:27:52.352745 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a7a6cb85-f82e-4dcb-ab7e-390a73c019b7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608219 Jun 24 08:27:52.353395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 512/1028] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:27:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:27:52.363503 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-aec4495b-545c-49c5-9e7e-3732ddd73a27 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:52.364174 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-aec4495b-545c-49c5-9e7e-3732ddd73a27 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:52.420411 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-aec4495b-545c-49c5-9e7e-3732ddd73a27 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:52.428956 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-aec4495b-545c-49c5-9e7e-3732ddd73a27 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1214 microversion: 2.1 time: 0.069227 Jun 24 08:27:52.429567 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 517/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:52 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:53.447608 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:53.448963 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:53.455470 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:53.455922 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:53.456697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:53.457129 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:53.540667 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:53.544627 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5e17fa58-4fa9-450b-9d51-3cae16a1f612 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1218 microversion: 2.1 time: 0.099339 Jun 24 08:27:53.545268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 513/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:53 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:27:54.562570 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:54.563246 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:54.570502 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:54.570973 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:54.571726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:54.572154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:54.636572 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:54.644730 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1adb0909-9eb5-45fa-8a32-08c0a7e38db9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1274 microversion: 2.1 time: 0.086858 Jun 24 08:27:54.645287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 518/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:54 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:55.670017 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:55.670625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:55.677691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:55.678142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:55.678913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:55.679348 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:55.817389 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:55.825709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8a6671de-3cef-4486-8700-90fb258bf069 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.159295 Jun 24 08:27:55.826067 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 514/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:55 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:56.114477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-f43eef6a-ac24-44b8-b6e4-3d98bf86529f req-5b3bf63f-6be6-409e-a01d-9f04e0962a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f", "tag": "48b800fa-abf2-487b-8a6d-69f486f6970b"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:27:56.122535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-f43eef6a-ac24-44b8-b6e4-3d98bf86529f req-5b3bf63f-6be6-409e-a01d-9f04e0962a33 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:56.122968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-f43eef6a-ac24-44b8-b6e4-3d98bf86529f req-5b3bf63f-6be6-409e-a01d-9f04e0962a33 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:56.138535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-f43eef6a-ac24-44b8-b6e4-3d98bf86529f req-5b3bf63f-6be6-409e-a01d-9f04e0962a33 service nova] Creating event network-changed:48b800fa-abf2-487b-8a6d-69f486f6970b for instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f on hv-cinder-83482 Jun 24 08:27:56.143707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-f43eef6a-ac24-44b8-b6e4-3d98bf86529f req-5b3bf63f-6be6-409e-a01d-9f04e0962a33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034119 Jun 24 08:27:56.144257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 519/1033] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:27:56.843934 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:56.845236 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:56.851652 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:56.852101 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:56.852904 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:56.853343 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:56.995952 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:57.003967 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-9b1aac20-9065-465b-b3c1-72978009c488 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.163877 Jun 24 08:27:57.004554 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 515/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:56 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:58.022438 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:58.023168 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:58.033837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:58.033837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:58.033837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:58.033837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:58.167276 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:58.175397 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-dc1088ca-37cc-4ad0-a283-9dc38e2db8db tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.157110 Jun 24 08:27:58.175902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 520/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:58 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:27:59.192890 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:27:59.193490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:27:59.195785 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:59.200559 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:59.201010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:59.201774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:27:59.202210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:27:59.205528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=87 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:59.349942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:27:59.357207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b1df9b3d-dc5a-4163-8abd-3c7ebeddddba tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.168924 Jun 24 08:27:59.357762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 516/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:27:59 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:00.374395 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:00.374997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:00.377168 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:00.381842 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:00.386565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:00.386565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:00.386565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:00.386565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:00.512552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:00.520482 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1ca75221-7239-4230-8307-7ce9bed5f2f8 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.149784 Jun 24 08:28:00.521071 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 521/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:00 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:01.536840 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:01.537476 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:01.543928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:01.544420 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:01.545167 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:01.545594 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:01.690138 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:01.697457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ede7187b-2a9e-427c-89e3-64b645139095 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.164539 Jun 24 08:28:01.698017 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 517/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:01 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:02.714757 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:02.715359 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:02.717162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:02.722958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:02.723398 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:02.724154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:02.724624 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:02.851679 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:02.858892 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3fd67784-ff1e-4679-8744-6103e676d000 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.148534 Jun 24 08:28:02.859453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 522/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:02 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:03.153465 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-daf34799-7d6f-48c4-aca0-2a160a25b697 req-91e05baa-17ae-4eb7-aef9-e2eab40553bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f", "name": "network-vif-plugged", "status": "completed", "tag": "48b800fa-abf2-487b-8a6d-69f486f6970b"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:03.159337 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:03.159337 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=6 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:03.164014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-daf34799-7d6f-48c4-aca0-2a160a25b697 req-91e05baa-17ae-4eb7-aef9-e2eab40553bd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:03.164495 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-daf34799-7d6f-48c4-aca0-2a160a25b697 req-91e05baa-17ae-4eb7-aef9-e2eab40553bd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:03.175503 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-daf34799-7d6f-48c4-aca0-2a160a25b697 req-91e05baa-17ae-4eb7-aef9-e2eab40553bd service nova] Creating event network-vif-plugged:48b800fa-abf2-487b-8a6d-69f486f6970b for instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f on hv-cinder-83482 Jun 24 08:28:03.180525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-daf34799-7d6f-48c4-aca0-2a160a25b697 req-91e05baa-17ae-4eb7-aef9-e2eab40553bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030718 Jun 24 08:28:03.181123 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 518/1040] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:28:03.877113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:03.877707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:03.883596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:03.884142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:03.884922 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:03.885350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:04.014122 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:04.022065 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b019a027-249c-4354-bdd4-ac555b7f457c tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.149773 Jun 24 08:28:04.022633 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 523/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:03 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:05.040247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:05.040947 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:05.047630 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:05.048134 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:05.048995 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:05.049435 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:05.181238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:05.189621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c8f47d94-f737-461c-9f3a-3f3557e284e7 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1314 microversion: 2.1 time: 0.154738 Jun 24 08:28:05.190165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 519/1042] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:05 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:06.207055 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:06.207672 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:06.213743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:06.214187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:06.214936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:06.215364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:06.345613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:06.353043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-aa9fbac3-8371-464a-bbdd-1f460e6c544b tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1497 microversion: 2.1 time: 0.150902 Jun 24 08:28:06.353597 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 524/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:06 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:10.192125 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:10.192706 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:10.199077 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:10.199528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:10.200318 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:10.200753 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:10.225303 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:28:10.446970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d32dd8a6-13b1-44fa-b5c2-7db2be1aa8bc tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 204 len: 0 microversion: 2.1 time: 0.258308 Jun 24 08:28:10.447504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 520/1044] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:28:10 2022] DELETE /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:28:10.455655 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:10.456287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:10.462262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:10.462707 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:10.463458 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:10.463890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:10.600335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:10.607670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bfecef99-fda0-4364-9fc8-dd3de120831d tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1503 microversion: 2.1 time: 0.155956 Jun 24 08:28:10.608244 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 525/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:10 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:28:11.625473 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:11.626163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:11.633090 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:11.633531 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:11.640852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:11.640852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:11.764006 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:11.771748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-589a7342-7e8f-4819-a3cf-0d92cfb95a39 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1503 microversion: 2.1 time: 0.150564 Jun 24 08:28:11.774217 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 521/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:11 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:12.788902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:12.789504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:12.795399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:12.795844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:12.796632 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:12.797063 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:12.864716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:12.873324 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9094ea16-ac34-4fc0-aef8-c28421e311e9 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1461 microversion: 2.1 time: 0.088210 Jun 24 08:28:12.874408 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 526/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:12 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:12.907966 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-ca4b0e94-08f3-4cc3-8eee-768eee9afc72 req-0c0b71a2-ad59-4b82-a72a-9c91d9dc7aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f", "name": "network-vif-deleted", "tag": "48b800fa-abf2-487b-8a6d-69f486f6970b"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:12.917153 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-ca4b0e94-08f3-4cc3-8eee-768eee9afc72 req-0c0b71a2-ad59-4b82-a72a-9c91d9dc7aa2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:12.917596 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-ca4b0e94-08f3-4cc3-8eee-768eee9afc72 req-0c0b71a2-ad59-4b82-a72a-9c91d9dc7aa2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:12.929151 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-ca4b0e94-08f3-4cc3-8eee-768eee9afc72 req-0c0b71a2-ad59-4b82-a72a-9c91d9dc7aa2 service nova] Creating event network-vif-deleted:48b800fa-abf2-487b-8a6d-69f486f6970b for instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f on hv-cinder-83482 Jun 24 08:28:12.934154 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-ca4b0e94-08f3-4cc3-8eee-768eee9afc72 req-0c0b71a2-ad59-4b82-a72a-9c91d9dc7aa2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029935 Jun 24 08:28:12.934799 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 522/1048] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:28:13.890601 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:13.891134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:13.898323 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:13.898763 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:13.899507 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:13.899933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:13.930258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:13.930699 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:13.931132 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lazy-loading 'fault' on Instance uuid 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:28:13.975233 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7359641c2f42f5887153ce08bad096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a997836914066a8aa2ebe98396d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:13.982091 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-b31ef4ca-6f77-4688-95d0-bf15e77a4099 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 200 len: 1304 microversion: 2.1 time: 0.095490 Jun 24 08:28:13.982698 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 527/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:13 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:14.999664 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:15.000311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] [instance: 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:15.009155 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:15.009699 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:15.010486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:15.010916 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:15.028044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] HTTP exception thrown: Instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f could not be found. Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Request method failure captured: Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f HTTP/1.1 Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXVugF6SNi5regzw8Ih-zWVRdLHGv9Bg8KSKL05K6NoQrvufg-GOLH9UigFwcGc-NENRk0bgo5KW6cN1KVoGgxI7F5_lozL44InN8atI60SRuSA-N9vosqewDR0yggT6ichyG3pYiyQP8HkSRUUCYsJl_F4JslBU8zvENsUnRGL_FhU Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 7e1a997836914066a8aa2ebe98396d1b Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-VolumesActionsTest-618077003 Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:28:15.029842 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e1a997836914066a8aa2ebe98396d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e1a997836914066a8aa2ebe98396d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e1a997836914066a8aa2ebe98396d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e1a997836914066a8aa2ebe98396d1b"}]}] Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-VolumesActionsTest-618077003 Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 7e1a997836914066a8aa2ebe98396d1b Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-VolumesActionsTest-618077003 Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-VolumesActionsTest-618077003-project Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: ad7359641c2f42f5887153ce08bad096 Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-VolumesActionsTest-618077003-project Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f could not be found. Jun 24 08:28:15.031779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f'} Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f could not be found. Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:28:15.032760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f could not be found. Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f could not be found. Jun 24 08:28:15.034826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:15.036271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] Returning 404 to user: Instance 1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:28:15.036271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-81f5286d-2d64-4c88-852e-f60e3cbfce55 tempest-VolumesActionsTest-618077003 tempest-VolumesActionsTest-618077003-project] 10.222.0.42 "GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f" status: 404 len: 111 microversion: 2.1 time: 0.036097 Jun 24 08:28:15.036271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 523/1050] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:14 2022] GET /compute/v2.1/servers/1d3c806b-2bcb-4d18-ba4b-c4667c4bc91f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:28:30.189930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:28:30.190540 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:28:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:28:30.793797 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:28:30.794897 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:28:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:28:34.648402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:28:34.649083 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:28:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:28:41.026017 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:41.026603 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:41.035507 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-17a5d912-d78b-430e-87ab-55882e502041 req-b1e47827-5bcb-4131-b153-69fbb87e127b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261fe17-2ca6-4028-8298-7b1e902a6bba", "tag": "eb456bc9-e755-4237-b02c-9c8369b8fd4e"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:41.037568 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=15 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:41.038344 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=43 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:41.039985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:41.040687 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:41.048470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:41.048933 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:41.049718 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:41.050150 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:41.053923 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-17a5d912-d78b-430e-87ab-55882e502041 req-b1e47827-5bcb-4131-b153-69fbb87e127b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:41.054373 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-17a5d912-d78b-430e-87ab-55882e502041 req-b1e47827-5bcb-4131-b153-69fbb87e127b service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:41.069575 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-17a5d912-d78b-430e-87ab-55882e502041 req-b1e47827-5bcb-4131-b153-69fbb87e127b service nova] Creating event network-changed:eb456bc9-e755-4237-b02c-9c8369b8fd4e for instance a261fe17-2ca6-4028-8298-7b1e902a6bba on hv-cinder-83482 Jun 24 08:28:41.075093 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-17a5d912-d78b-430e-87ab-55882e502041 req-b1e47827-5bcb-4131-b153-69fbb87e127b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047206 Jun 24 08:28:41.076451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 524/1051] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:28:41.089273 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:28:41.407339 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e234303a-a60b-4dc2-b6fd-d599038e41b6 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 204 len: 0 microversion: 2.1 time: 0.385278 Jun 24 08:28:41.416649 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 528/1052] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:28:41 2022] DELETE /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:28:41.428882 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:41.429451 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:41.447169 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:41.447955 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:41.448789 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:41.449208 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:41.816089 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:41.824247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-00823167-e047-4ff8-90a3-cb444325b91b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1577 microversion: 2.1 time: 0.401517 Jun 24 08:28:41.825179 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 525/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:41 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1577 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:42.841552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:42.843035 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:42.851857 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:42.852350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:42.853121 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:42.853926 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:43.178340 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:43.188154 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0246e752-6424-4e6d-bad2-29aab20835b9 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1577 microversion: 2.1 time: 0.350572 Jun 24 08:28:43.189114 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 529/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:42 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1577 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:44.078769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-3b1919c1-ad87-4012-94ad-a56a1779f33e req-0ca4f105-15b4-485c-871f-4f9de11b1cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261fe17-2ca6-4028-8298-7b1e902a6bba", "name": "network-vif-deleted", "tag": "eb456bc9-e755-4237-b02c-9c8369b8fd4e"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:44.089833 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-3b1919c1-ad87-4012-94ad-a56a1779f33e req-0ca4f105-15b4-485c-871f-4f9de11b1cfe service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:44.090630 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-3b1919c1-ad87-4012-94ad-a56a1779f33e req-0ca4f105-15b4-485c-871f-4f9de11b1cfe service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:44.103309 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-3b1919c1-ad87-4012-94ad-a56a1779f33e req-0ca4f105-15b4-485c-871f-4f9de11b1cfe service nova] Creating event network-vif-deleted:eb456bc9-e755-4237-b02c-9c8369b8fd4e for instance a261fe17-2ca6-4028-8298-7b1e902a6bba on hv-cinder-83482 Jun 24 08:28:44.108977 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-3b1919c1-ad87-4012-94ad-a56a1779f33e req-0ca4f105-15b4-485c-871f-4f9de11b1cfe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Jun 24 08:28:44.109623 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 526/1055] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:28:44.205880 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:44.206490 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:44.212696 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:44.213139 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:44.213900 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:44.214332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:44.276901 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:44.284801 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-a2e80e64-9bf4-4f2f-ac1b-362149652a00 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1392 microversion: 2.1 time: 0.082735 Jun 24 08:28:44.285484 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 530/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:44 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1392 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:45.304928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:45.305616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:45.315826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:45.315826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:45.315826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:45.315826 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:45.350025 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:45.350731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:45.351227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lazy-loading 'fault' on Instance uuid a261fe17-2ca6-4028-8298-7b1e902a6bba {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:28:45.411431 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:45.419385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f11aa047-f54a-441c-aa98-5acd5b45150b tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 200 len: 1231 microversion: 2.1 time: 0.121191 Jun 24 08:28:45.425032 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 527/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:45 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 1231 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:46.436827 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:46.437423 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: a261fe17-2ca6-4028-8298-7b1e902a6bba] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:46.447498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:46.447498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:46.447498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:46.447498 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:46.463008 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] HTTP exception thrown: Instance a261fe17-2ca6-4028-8298-7b1e902a6bba could not be found. Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Request method failure captured: Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba HTTP/1.1 Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXPB6jB1OwI0EwLDViEEYjHan2Zg-sPuzB-uWJt3YpsLalS6mUvzNaYTT8zJWE0WZcYgjr-GTbyRUqFnXK3qMWwIIdiSXeNxGLcCYMyqdLsZWOk_YNHqDmEM9V0miZiD1IAkfTbBz5rr7iYZyMuHpkvHTLVrrXitxIONIU0wpwbadlk Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:28:46.464982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9170777eb80e46bd9d8ea3a576a9678c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}] Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 01fe8c57517d4ca5958ec13139aa2b74 Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance a261fe17-2ca6-4028-8298-7b1e902a6bba could not be found. Jun 24 08:28:46.466549 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'a261fe17-2ca6-4028-8298-7b1e902a6bba'} Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a261fe17-2ca6-4028-8298-7b1e902a6bba could not be found. Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:28:46.467850 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a261fe17-2ca6-4028-8298-7b1e902a6bba could not be found. Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a261fe17-2ca6-4028-8298-7b1e902a6bba could not be found. Jun 24 08:28:46.469734 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:46.473322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Returning 404 to user: Instance a261fe17-2ca6-4028-8298-7b1e902a6bba could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:28:46.473322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1889e844-dcc0-4d8a-9e59-5e7fa7b511ff tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba" status: 404 len: 111 microversion: 2.1 time: 0.034132 Jun 24 08:28:46.482007 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 531/1058] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:46 2022] GET /compute/v2.1/servers/a261fe17-2ca6-4028-8298-7b1e902a6bba => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:28:50.770640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:50.771287 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:50.776896 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-52e8b997-1b22-42ae-bd8c-2e928a645c4a req-ac363a00-34dd-4e73-8847-286da75c65a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdae3c8-cd18-4640-9b59-23bc29ae1383", "tag": "49476779-f723-492d-a807-c92bf6bf2ca5"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:50.788062 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:50.790513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:50.790842 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-52e8b997-1b22-42ae-bd8c-2e928a645c4a req-ac363a00-34dd-4e73-8847-286da75c65a1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:50.790981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:50.790981 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:50.791719 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-52e8b997-1b22-42ae-bd8c-2e928a645c4a req-ac363a00-34dd-4e73-8847-286da75c65a1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:50.807216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-52e8b997-1b22-42ae-bd8c-2e928a645c4a req-ac363a00-34dd-4e73-8847-286da75c65a1 service nova] Creating event network-changed:49476779-f723-492d-a807-c92bf6bf2ca5 for instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 on hv-cinder-83482 Jun 24 08:28:50.814142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-52e8b997-1b22-42ae-bd8c-2e928a645c4a req-ac363a00-34dd-4e73-8847-286da75c65a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041282 Jun 24 08:28:50.820069 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 532/1059] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:28:50.840069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:28:51.317751 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-410e3966-3bcf-4ab9-bcda-f97d0594227a tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 204 len: 0 microversion: 2.1 time: 0.550225 Jun 24 08:28:51.318334 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 528/1060] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:28:50 2022] DELETE /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:28:51.328685 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:51.329613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:51.337470 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:51.338134 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:51.339170 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:51.339755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:51.646722 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:51.652280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9d34f81c-2021-4d3a-b7d6-89c02469021c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1579 microversion: 2.1 time: 0.327892 Jun 24 08:28:51.653089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 533/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:51 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1579 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:52.671898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:52.673020 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:52.686469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:52.690405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:52.692825 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:52.695646 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:52.949313 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:52.962542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-135c69bb-97c3-4973-8cc6-bdecd8e83449 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1579 microversion: 2.1 time: 0.295903 Jun 24 08:28:52.975599 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 529/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:52 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1579 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:53.982831 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:53.984341 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:53.991465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:53.996061 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:53.997419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:54.000977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:54.201477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:54.219997 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-22331439-77c1-475d-9ee5-7fe59e5c797c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1460 microversion: 2.1 time: 0.240991 Jun 24 08:28:54.221048 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 534/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:53 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1460 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:54.463636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-43db96fc-22d7-4097-be90-4b7cf41c3a6d req-5602c574-d40d-4a51-9ebc-cdaade64ff6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdae3c8-cd18-4640-9b59-23bc29ae1383", "name": "network-vif-deleted", "tag": "49476779-f723-492d-a807-c92bf6bf2ca5"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:54.478535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-43db96fc-22d7-4097-be90-4b7cf41c3a6d req-5602c574-d40d-4a51-9ebc-cdaade64ff6a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:54.478976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-43db96fc-22d7-4097-be90-4b7cf41c3a6d req-5602c574-d40d-4a51-9ebc-cdaade64ff6a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:54.512633 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-43db96fc-22d7-4097-be90-4b7cf41c3a6d req-5602c574-d40d-4a51-9ebc-cdaade64ff6a service nova] Creating event network-vif-deleted:49476779-f723-492d-a807-c92bf6bf2ca5 for instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 on hv-cinder-83482 Jun 24 08:28:54.530312 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-43db96fc-22d7-4097-be90-4b7cf41c3a6d req-5602c574-d40d-4a51-9ebc-cdaade64ff6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069937 Jun 24 08:28:54.531448 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 530/1064] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:28:55.245093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:55.245694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:55.251940 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:55.252615 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:55.253473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:55.253907 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:55.341350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fe8c57517d4ca5958ec13139aa2b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9170777eb80e46bd9d8ea3a576a9678c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:28:55.350725 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-53d3c8b2-ef3e-43c4-bbf9-a4312d05e8dc tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 200 len: 1226 microversion: 2.1 time: 0.109610 Jun 24 08:28:55.351672 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 535/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:55 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:28:56.370457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:56.372621 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 3cdae3c8-cd18-4640-9b59-23bc29ae1383] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:56.403771 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:56.404350 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:56.406402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:56.421590 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:56.471116 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] HTTP exception thrown: Instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 could not be found. Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Request method failure captured: Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 HTTP/1.1 Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXPB6jB1OwI0EwLDViEEYjHan2Zg-sPuzB-uWJt3YpsLalS6mUvzNaYTT8zJWE0WZcYgjr-GTbyRUqFnXK3qMWwIIdiSXeNxGLcCYMyqdLsZWOk_YNHqDmEM9V0miZiD1IAkfTbBz5rr7iYZyMuHpkvHTLVrrXitxIONIU0wpwbadlk Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:28:56.474211 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9170777eb80e46bd9d8ea3a576a9678c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}] Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 01fe8c57517d4ca5958ec13139aa2b74 Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 could not be found. Jun 24 08:28:56.475762 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '3cdae3c8-cd18-4640-9b59-23bc29ae1383'} Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 could not be found. Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:28:56.477039 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 could not be found. Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 could not be found. Jun 24 08:28:56.478395 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:56.481239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Returning 404 to user: Instance 3cdae3c8-cd18-4640-9b59-23bc29ae1383 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:28:56.481239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0f03cefb-a346-46f2-858b-dda54c35238c tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383" status: 404 len: 111 microversion: 2.1 time: 0.110084 Jun 24 08:28:56.481239 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 531/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:56 2022] GET /compute/v2.1/servers/3cdae3c8-cd18-4640-9b59-23bc29ae1383 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:28:57.962708 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:57.963286 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:57.976749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:57.978747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:57.981779 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:57.982439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:58.052468 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] HTTP exception thrown: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Request method failure captured: Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb HTTP/1.1 Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXPB6jB1OwI0EwLDViEEYjHan2Zg-sPuzB-uWJt3YpsLalS6mUvzNaYTT8zJWE0WZcYgjr-GTbyRUqFnXK3qMWwIIdiSXeNxGLcCYMyqdLsZWOk_YNHqDmEM9V0miZiD1IAkfTbBz5rr7iYZyMuHpkvHTLVrrXitxIONIU0wpwbadlk Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:28:58.064500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9170777eb80e46bd9d8ea3a576a9678c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}] Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: 01fe8c57517d4ca5958ec13139aa2b74 Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.066889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': '401989f0-8369-4e86-92c8-76b65a93f9cb'} Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:28:58.067863 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.080975 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.082866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Returning 404 to user: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:28:58.082866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f1f694c1-1d2e-42e1-9be5-63b69a69b50e tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "DELETE /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 404 len: 111 microversion: 2.1 time: 0.117243 Jun 24 08:28:58.082866 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 536/1067] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:28:57 2022] DELETE /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:28:58.086338 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:28:58.087228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] [instance: 401989f0-8369-4e86-92c8-76b65a93f9cb] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:28:58.125044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:58.127012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:58.130021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:28:58.132288 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:28:58.164772 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] HTTP exception thrown: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Request method failure captured: Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb HTTP/1.1 Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXPB6jB1OwI0EwLDViEEYjHan2Zg-sPuzB-uWJt3YpsLalS6mUvzNaYTT8zJWE0WZcYgjr-GTbyRUqFnXK3qMWwIIdiSXeNxGLcCYMyqdLsZWOk_YNHqDmEM9V0miZiD1IAkfTbBz5rr7iYZyMuHpkvHTLVrrXitxIONIU0wpwbadlk Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:28:58.166681 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9170777eb80e46bd9d8ea3a576a9678c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9170777eb80e46bd9d8ea3a576a9678c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9170777eb80e46bd9d8ea3a576a9678c"}]}] Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: 9170777eb80e46bd9d8ea3a576a9678c Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464800250 Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: 01fe8c57517d4ca5958ec13139aa2b74 Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-TestVolumeBootPattern-1464800250-project Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.168419 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '401989f0-8369-4e86-92c8-76b65a93f9cb'} Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:28:58.169387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. Jun 24 08:28:58.171001 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:28:58.173051 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Returning 404 to user: Instance 401989f0-8369-4e86-92c8-76b65a93f9cb could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:28:58.173051 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4fe3a49d-37f4-40cb-9261-e4e7896bc9a5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb" status: 404 len: 111 microversion: 2.1 time: 0.092120 Jun 24 08:28:58.173564 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 532/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:28:58 2022] GET /compute/v2.1/servers/401989f0-8369-4e86-92c8-76b65a93f9cb => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:28:59.765825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-33427c7e-433a-4393-9a54-03a6e0d1226c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Action: 'create', calling method: .version_select at 0x7f14962ee310>, body: {"keypair": {"name": "tempest-TestShelveInstance-152769386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSM/JXfi62gajwTD08C/TgnN05aBuHLCOIf8mjExUHfq3qR+1kW4WCeTLmrCGBb5YEH/f4HcDxbawUJY4c3VWri3Vt3QYajqCDjSTnoX90W/zY9zLQDEAPI7ltHG9FQcw=="}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:28:59.808186 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-33427c7e-433a-4393-9a54-03a6e0d1226c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Getting quotas for project bdb93f2721d548d7b01475fb650d882f. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:28:59.815606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-33427c7e-433a-4393-9a54-03a6e0d1226c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Getting quotas for user a9150eafa2cc41f5ac56105976d658a2 and project bdb93f2721d548d7b01475fb650d882f. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:29:00.008165 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-33427c7e-433a-4393-9a54-03a6e0d1226c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.590520 Jun 24 08:29:00.009534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 537/1069] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:28:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:00.012573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-200626dc-588d-45e4-98de-ce32e294cdc5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] Calling method '.version_select at 0x7f1496360700>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:00.138405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-200626dc-588d-45e4-98de-ce32e294cdc5 tempest-TestVolumeBootPattern-1464800250 tempest-TestVolumeBootPattern-1464800250-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1900007784" status: 202 len: 0 microversion: 2.1 time: 0.129435 Jun 24 08:29:00.138990 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 533/1070] 10.222.0.42 () {58 vars in 1262 bytes} [Fri Jun 24 08:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1900007784 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:29:17.726980 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:17.727749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:17.728410 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:17.732293 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4b624f16-5219-4937-87df-ce5e1236ed80 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Action: 'create', calling method: .version_select at 0x7f1496104dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-184635921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcxVn+YGFr/4cC1pFKyItM5s7RTTgxz9oKoOD29JW6KOeZyIKWTwiPYU0EataaCTPqWaV6w6pg93C7a6E4yNc+8XgS6DH88OljxLGFleR0nxiO/fCKqRI/Z3ut+mEgRvA=="}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:17.747662 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-4b624f16-5219-4937-87df-ce5e1236ed80 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Getting quotas for project c9cf7969a63e46e9aeef5dc53410d51b. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:29:17.751368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-4b624f16-5219-4937-87df-ce5e1236ed80 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Getting quotas for user f45b823dc34b4c17818b1afec6c33d0b and project c9cf7969a63e46e9aeef5dc53410d51b. Resources: {'key_pairs'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:29:17.814477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4b624f16-5219-4937-87df-ce5e1236ed80 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.088308 Jun 24 08:29:17.815180 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 538/1071] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 24 08:29:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:17.914483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-982702978", "imageRef": "925d25fd-6d32-4555-86de-6240e966a169", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-184635921", "networks": [{"uuid": "7ac9cc24-5f77-4842-9dc4-92ca5cbc698b"}]}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:17.921589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:17.922237 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:17.967636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.network.neutron [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] validate_networks() for [('7ac9cc24-5f77-4842-9dc4-92ca5cbc698b', None, None, None, None, None)] {{(pid=118296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:29:18.446238 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Flavor limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:29:18.446658 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Image limits 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:29:18.447150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Flavor pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:29:18.447556 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Image pref 0:0:0 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:29:18.447961 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.virt.hardware [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:29:18.457302 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:18.457742 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:18.458528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:18.458963 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:18.475629 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Getting quotas for project c9cf7969a63e46e9aeef5dc53410d51b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:29:18.479563 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.quota [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Getting quotas for user f45b823dc34b4c17818b1afec6c33d0b and project c9cf7969a63e46e9aeef5dc53410d51b. Resources: {'ram', 'cores', 'instances'} {{(pid=118296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:29:18.490377 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Going to run 1 instances... {{(pid=118296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:29:18.492554 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='925d25fd-6d32-4555-86de-6240e966a169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:29:18.624970 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b81aea04-72e7-40df-bcec-4cb7b492f15b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714291 Jun 24 08:29:18.625546 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 534/1072] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:29:18.635738 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-42892948-7164-41eb-a335-f3011c69f359 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:18.636524 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-42892948-7164-41eb-a335-f3011c69f359 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:18.694117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-42892948-7164-41eb-a335-f3011c69f359 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:18.711049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-42892948-7164-41eb-a335-f3011c69f359 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1257 microversion: 2.1 time: 0.079082 Jun 24 08:29:18.711621 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 539/1073] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:18 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1257 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:19.728418 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:19.729058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:19.736032 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:19.739229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:19.739229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:19.739229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:19.804087 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:19.811769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a6860d20-a913-45bf-9296-1c46309a2870 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1261 microversion: 2.1 time: 0.087851 Jun 24 08:29:19.812349 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 535/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:19 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:20.814982 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-361825631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-152769386", "security_groups": [{"name": "tempest-secgroup-smoke-111969689"}], "networks": [{"uuid": "b10222ad-d87f-4831-aa8f-cd96b61e2ae2"}], "block_device_mapping_v2": [{"uuid": "4aca2097-56d9-4716-ac16-7b2b5e6fc390", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:20.828477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:20.829081 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:20.835976 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:20.836649 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:20.837328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:20.837765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:20.921170 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:20.930141 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-1232c0e3-835f-46bd-b05c-9edf49aff232 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1317 microversion: 2.1 time: 0.105564 Jun 24 08:29:20.931236 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 536/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:20 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1317 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:29:20.957227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.network.neutron [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] validate_networks() for [('b10222ad-d87f-4831-aa8f-cd96b61e2ae2', None, None, None, None, None)] {{(pid=118295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:29:21.411596 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Flavor limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:29:21.412613 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Image limits 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:29:21.413366 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Flavor pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:29:21.414207 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Image pref 0:0:0 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:29:21.414841 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.virt.hardware [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:29:21.426798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:21.427243 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:21.428039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:21.428936 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:21.446867 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Getting quotas for project bdb93f2721d548d7b01475fb650d882f. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:29:21.450818 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.quota [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Getting quotas for user a9150eafa2cc41f5ac56105976d658a2 and project bdb93f2721d548d7b01475fb650d882f. Resources: {'ram', 'cores', 'instances'} {{(pid=118295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:29:21.518491 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Going to run 1 instances... {{(pid=118295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:29:21.522858 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4aca2097-56d9-4716-ac16-7b2b5e6fc390',volume_size=None,volume_type=None)] {{(pid=118295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:29:21.947709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:21.949091 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:21.959886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:21.961513 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:21.963328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:21.966218 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:22.100702 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-30f13008-52f9-4552-82d3-e877be4f133b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.285588 Jun 24 08:29:22.101578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 540/1076] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 24 08:29:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:29:22.112574 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1299d9d3-f412-46be-906a-cc341838631f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:22.113972 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1299d9d3-f412-46be-906a-cc341838631f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:22.198273 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1299d9d3-f412-46be-906a-cc341838631f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:22.209355 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:22.218205 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e5aaa3f2-968e-415f-9847-f6f672db3488 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.274113 Jun 24 08:29:22.218608 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1299d9d3-f412-46be-906a-cc341838631f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1087 microversion: 2.1 time: 0.109339 Jun 24 08:29:22.219387 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 537/1077] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:21 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:22.227331 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 541/1078] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:22 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1087 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:23.234956 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e8b0ee15-6325-4bde-ba5c-5186bb5235a8 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:23.235427 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:23.236098 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:23.237128 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e8b0ee15-6325-4bde-ba5c-5186bb5235a8 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:23.245280 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:23.245824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:23.246801 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:23.247327 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:23.346488 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e8b0ee15-6325-4bde-ba5c-5186bb5235a8 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:23.354287 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e8b0ee15-6325-4bde-ba5c-5186bb5235a8 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1087 microversion: 2.1 time: 0.123275 Jun 24 08:29:23.355135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 538/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:23 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1087 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:23.439251 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:23.448631 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ba8def6f-bcef-4703-88a8-077c6f4f6c2f tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.217631 Jun 24 08:29:23.449211 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 542/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:23 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:24.371771 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:24.372402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:24.380328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:24.380780 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:24.381551 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:24.381985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:24.447897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:24.455474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b130f8c8-4817-4191-9a49-495606d511af tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1137 microversion: 2.1 time: 0.087790 Jun 24 08:29:24.456048 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 539/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:24 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:29:24.466466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:24.467987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:24.474356 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:24.474800 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:24.475563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:24.475996 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:24.612034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:24.620452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-124271e1-e798-4102-ba4a-79fbc120c029 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.157829 Jun 24 08:29:24.621486 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 543/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:24 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:25.473663 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:25.475021 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:25.482535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:25.483072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:25.484074 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:25.484550 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:25.550406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:25.558917 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b52d959d-12e0-4306-9cbe-6a6ec51880f3 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1137 microversion: 2.1 time: 0.089543 Jun 24 08:29:25.559591 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 540/1083] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:25 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:25.638748 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:25.639414 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:25.645856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:25.646291 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:25.647051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:25.647481 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:25.785279 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:25.793344 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1cf10944-5056-498c-b01f-56869705e5b3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.158359 Jun 24 08:29:25.794169 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 544/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:25 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:26.582683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:26.583345 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:26.589721 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:26.590163 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:26.590929 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:26.591359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:26.657402 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:26.665889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-93e425fb-78b4-4ed6-a433-3397fa5fef69 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1137 microversion: 2.1 time: 0.092435 Jun 24 08:29:26.667086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 541/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:26 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:26.811595 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:26.812253 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:26.819527 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:26.819977 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:26.820775 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:26.821447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:26.960617 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:26.968058 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-06e3f974-fb8b-4b52-b78c-9bfad43e4409 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.160722 Jun 24 08:29:26.968684 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 545/1086] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:26 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:27.682896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:27.683518 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:27.690145 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:27.690588 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:27.691850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:27.692890 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:27.760004 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:27.767887 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-84dc8086-1cf7-41dd-8fdb-f0d3951223f1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1137 microversion: 2.1 time: 0.088791 Jun 24 08:29:27.768504 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 542/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:27 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:27.985696 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:27.987215 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:27.995052 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:27.995492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:27.996278 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:27.996739 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:28.136330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:28.144039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-26872f76-e69f-4a48-8dbb-b823c5b95e72 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.162500 Jun 24 08:29:28.145183 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 546/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:27 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:28.785493 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:28.786234 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:28.788219 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:28.794372 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:28.794830 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:28.795602 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:28.796301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:28.864720 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:28.871268 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-696311a0-fcc3-402b-9c97-f8e3761074a2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1137 microversion: 2.1 time: 0.089742 Jun 24 08:29:28.871846 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 543/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:28 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:29.162189 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:29.162762 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:29.168987 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:29.169764 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:29.170768 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:29.171258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:29.310839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:29.318487 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-83db9f1d-0f9f-4845-9c4a-b096ea7a6b06 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.160472 Jun 24 08:29:29.319043 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 547/1090] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:29 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:29.888659 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:29.889281 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:29.896964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:29.897404 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:29.898150 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:29.898576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:29.961220 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:29.968892 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ce531a0e-b1d2-468a-b333-ad7baacebd77 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1137 microversion: 2.1 time: 0.084032 Jun 24 08:29:29.969649 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 544/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:29 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:30.335015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:30.335661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:30.341641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:30.342089 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:30.342853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:30.343297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:30.474500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:30.482509 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-cbf0d204-7888-40a3-8730-191028f6ee00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.151416 Jun 24 08:29:30.483159 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 548/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:30 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:30.986201 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:30.986867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:30.994165 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:30.994609 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:30.995361 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:30.995789 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:31.065618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:31.074930 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-b048aba4-346c-4ce3-8d98-b0ea4247f19f tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1129 microversion: 2.1 time: 0.091069 Jun 24 08:29:31.076055 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 545/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:30 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1129 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:31.208492 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-cf3f7f17-7a0a-44b5-99a8-e27670fa170b req-ade8e1a6-3500-4e53-8014-b2c369a8f732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:31.216710 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-cf3f7f17-7a0a-44b5-99a8-e27670fa170b req-ade8e1a6-3500-4e53-8014-b2c369a8f732 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:31.217177 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-cf3f7f17-7a0a-44b5-99a8-e27670fa170b req-ade8e1a6-3500-4e53-8014-b2c369a8f732 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:31.229453 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-cf3f7f17-7a0a-44b5-99a8-e27670fa170b req-ade8e1a6-3500-4e53-8014-b2c369a8f732 service nova] Creating event network-changed:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:29:31.234846 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-cf3f7f17-7a0a-44b5-99a8-e27670fa170b req-ade8e1a6-3500-4e53-8014-b2c369a8f732 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166507 Jun 24 08:29:31.235455 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 549/1094] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:31.500683 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:31.501290 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:31.508574 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:31.509135 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:31.511876 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:31.511876 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:31.677474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:31.685161 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fa42323a-ecda-4980-8bc4-e64a6e8b87ee tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.188257 Jun 24 08:29:31.685932 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 546/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:31 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:32.090262 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:32.094426 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:32.095141 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:32.101749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:32.102197 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:32.102952 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:32.103374 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:32.170390 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:32.178454 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9b32c3a4-5c7f-47fe-a0b4-2bd135cd778e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1129 microversion: 2.1 time: 0.089114 Jun 24 08:29:32.179015 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 550/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:32 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1129 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:29:32.702845 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:32.703460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:32.710200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:32.710653 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:32.711418 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:32.711852 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:32.841850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:32.850266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a76b2b4c-0f14-4034-acbf-957edabae469 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.151307 Jun 24 08:29:32.850829 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 547/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:32 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:33.197530 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:33.198212 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:33.199965 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=14 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.204958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:33.205394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:33.206184 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:33.206603 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:33.268700 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:33.277164 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e730a51e-0d41-4aa1-8d70-efda4ed0dc7d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1185 microversion: 2.1 time: 0.084043 Jun 24 08:29:33.277721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 551/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:33 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:33.867371 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:33.867983 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:33.870909 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell0:SELECT=8 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.874985 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:33.875432 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:33.876212 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:33.876647 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:34.012812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:34.021311 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5bca4ceb-0b1c-4bc2-a499-44156dbcddea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.158273 Jun 24 08:29:34.021872 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 548/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:33 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:34.294532 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:34.295137 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:34.301006 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:34.301444 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:34.302202 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:34.302630 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:34.367969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:34.375368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-318fb68f-a226-4869-b0d2-3a8eadebdc15 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1203 microversion: 2.1 time: 0.084920 Jun 24 08:29:34.375937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 552/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:34 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:35.038497 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:35.039105 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:35.045775 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:35.046227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:35.046979 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:35.047411 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:35.193539 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:35.201262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-32a719bf-25db-4327-af86-97a70440cf36 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.167110 Jun 24 08:29:35.201849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 549/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:35 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:35.393067 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:35.393921 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:35.406396 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:35.406868 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:35.407618 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:35.408050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:35.415815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-e9ff3d4a-74f2-46ff-8ab7-0e6c157f7538 req-8a6376ab-bc8c-4296-8dc7-afff8bf1806a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:35.429198 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e9ff3d4a-74f2-46ff-8ab7-0e6c157f7538 req-8a6376ab-bc8c-4296-8dc7-afff8bf1806a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:35.430076 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e9ff3d4a-74f2-46ff-8ab7-0e6c157f7538 req-8a6376ab-bc8c-4296-8dc7-afff8bf1806a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:35.451412 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-e9ff3d4a-74f2-46ff-8ab7-0e6c157f7538 req-8a6376ab-bc8c-4296-8dc7-afff8bf1806a service nova] Creating event network-changed:63717731-c5c4-450f-afb5-a1b6a31dd3ef for instance a806a5c6-8671-407e-9065-5c025b344310 on hv-cinder-83482 Jun 24 08:29:35.468053 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-e9ff3d4a-74f2-46ff-8ab7-0e6c157f7538 req-8a6376ab-bc8c-4296-8dc7-afff8bf1806a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057520 Jun 24 08:29:35.469251 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 550/1102] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:35.599889 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:35.609494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-050337b2-7a4b-4a61-a318-fd35721335d4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.220414 Jun 24 08:29:35.610720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 553/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:35 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:36.219915 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:36.225365 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:36.227800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:36.228279 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:36.229037 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:36.229463 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:36.365040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:36.372525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3c940174-f6dd-4863-906f-740b25bfc790 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.157340 Jun 24 08:29:36.373224 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 551/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:36 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:36.626847 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:36.627370 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:36.633299 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:36.633736 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:36.634478 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:36.634903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:36.762045 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:36.769373 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0e9554bc-9521-494e-a699-c3147aa7a091 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.146430 Jun 24 08:29:36.770424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 554/1105] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:36 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:37.389341 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:37.389949 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:37.397480 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:37.397938 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:37.398704 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:37.399142 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:37.530893 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:37.534477 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=100 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:37.538950 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-59345240-bdcc-4935-a3e1-38d83a4c59a1 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.153422 Jun 24 08:29:37.539523 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 552/1106] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:37 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:37.606447 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-13621771-8d0c-426c-ae9e-6a0d04cb36b5 req-0232189a-bf58-4942-8626-af9de3c3baa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "name": "network-vif-plugged", "status": "completed", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:37.614954 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-13621771-8d0c-426c-ae9e-6a0d04cb36b5 req-0232189a-bf58-4942-8626-af9de3c3baa4 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:37.615403 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-13621771-8d0c-426c-ae9e-6a0d04cb36b5 req-0232189a-bf58-4942-8626-af9de3c3baa4 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:37.626076 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-13621771-8d0c-426c-ae9e-6a0d04cb36b5 req-0232189a-bf58-4942-8626-af9de3c3baa4 service nova] Creating event network-vif-plugged:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:29:37.631517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-13621771-8d0c-426c-ae9e-6a0d04cb36b5 req-0232189a-bf58-4942-8626-af9de3c3baa4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087155 Jun 24 08:29:37.632113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 555/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:29:37.786770 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:37.787472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:37.794000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:37.796754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:37.796754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:37.796754 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:37.928784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:37.936221 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-d3384b44-1d3f-4d4e-ba05-07c667aab7e5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.153493 Jun 24 08:29:37.937033 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 553/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:37 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:38.555400 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:38.556092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:38.562528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:38.562969 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:38.563723 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:38.564149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:38.690335 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:38.698666 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-ca9ce6be-98c6-45d2-aa6d-ad6784421e9e tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1357 microversion: 2.1 time: 0.147566 Jun 24 08:29:38.699225 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 556/1109] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:38 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:38.953708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:38.954270 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:38.960845 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:38.963461 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:38.963461 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:38.963461 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:39.101881 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:39.109354 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-74a54d5e-687f-47e2-8705-d5df34201b5c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.159560 Jun 24 08:29:39.109919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 554/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:38 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:39.716118 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:39.716759 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:39.722853 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:39.723948 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:39.724763 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:39.725195 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:39.853136 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:39.860429 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-9d62ada9-436b-42c2-91d9-83272b494fb7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1548 microversion: 2.1 time: 0.148113 Jun 24 08:29:39.860988 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 557/1111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:39 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:39.876913 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:39.880483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:39.884170 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:39.884638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:39.885385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:39.885811 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.017272 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:40.025440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ada7f26d-f05f-45f9-80ed-5e1584742d81 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1548 microversion: 2.1 time: 0.152431 Jun 24 08:29:40.025996 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 555/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:39 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:40.041419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:40.044849 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:40.045618 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Searching by: {'deleted': False, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b'} {{(pid=118295) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 08:29:40.052591 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:40.053037 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.053825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:40.054300 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.126822 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:40.127336 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:40.134301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:40.134753 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.135500 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:40.136018 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.145330 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.multi_cell_list [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118295) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 08:29:40.240268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-95955a2b-efab-4b45-bbcd-dded612dd317 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202476 Jun 24 08:29:40.241274 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 558/1113] 10.222.0.42 () {58 vars in 1124 bytes} [Fri Jun 24 08:29:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:40.250517 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:40.251117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:40.257499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:40.257941 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.258697 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:40.259128 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:40.264552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=100 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:40.268587 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:40.278040 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cb232c03-be3e-43fa-9b9b-ed6c32c2362b tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.155017 Jun 24 08:29:40.278616 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 556/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:40 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:29:40.396812 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:40.404179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2ab420e6-9726-4ec9-9cdf-ca14ed42c806 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1548 microversion: 2.1 time: 0.157329 Jun 24 08:29:40.404758 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 559/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:40 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:29:41.299058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:41.299658 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:41.306189 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:41.306797 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:41.307469 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:41.307898 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:41.438472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:41.446122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-19bcef42-b539-48e6-9b4c-012d832e361a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.151135 Jun 24 08:29:41.446684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 557/1116] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:41 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:42.331332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9b3b103-3116-45b0-b279-72e589af50b6"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:42.332667 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:42.338553 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:42.338995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:42.339743 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:42.340176 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:42.467256 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:42.468012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:42.475582 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:42.476033 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:42.476841 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:42.477278 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:42.623146 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:42.630636 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e1b3d25b-94ce-4c5c-acf7-3914d31b922d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.167331 Jun 24 08:29:42.631200 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 558/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:42 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:43.238265 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-bede1250-dc80-4688-a086-f85cafe0156a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910652 Jun 24 08:29:43.238871 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 560/1118] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 24 08:29:42 2022] POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:43.648385 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:43.648999 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:43.655535 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:43.655986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:43.656846 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:43.661640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:43.792398 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:43.799973 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c331fb65-eb7c-4592-b3f0-cf4b3e8bf121 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.155493 Jun 24 08:29:43.800579 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 559/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:43 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:44.819049 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:44.819726 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:44.826610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:44.827142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:44.827961 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:44.828439 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:44.958937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:44.966304 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4b4a48f2-77ac-45bd-8b17-294cd9435e73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.152565 Jun 24 08:29:44.966856 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 561/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:44 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:45.578490 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-3c703755-c1d6-4947-ba43-8769704f763f req-71dd192d-7297-4d5d-a46c-314f7c40c715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "name": "network-vif-plugged", "status": "completed", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:45.587133 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-3c703755-c1d6-4947-ba43-8769704f763f req-71dd192d-7297-4d5d-a46c-314f7c40c715 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:45.587567 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-3c703755-c1d6-4947-ba43-8769704f763f req-71dd192d-7297-4d5d-a46c-314f7c40c715 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:45.598188 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-3c703755-c1d6-4947-ba43-8769704f763f req-71dd192d-7297-4d5d-a46c-314f7c40c715 service nova] Creating event network-vif-plugged:63717731-c5c4-450f-afb5-a1b6a31dd3ef for instance a806a5c6-8671-407e-9065-5c025b344310 on hv-cinder-83482 Jun 24 08:29:45.603936 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-3c703755-c1d6-4947-ba43-8769704f763f req-71dd192d-7297-4d5d-a46c-314f7c40c715 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029371 Jun 24 08:29:45.604552 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 560/1121] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:45.983055 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:45.983638 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:45.991267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:45.991708 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:45.992557 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:45.992991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:46.126727 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:46.134661 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-350c1417-fd01-4d90-ad81-94592c6df77a tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.155596 Jun 24 08:29:46.135214 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 562/1122] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:45 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:47.153043 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:47.153801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:47.159928 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:47.166071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:47.166071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:47.166071 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:47.299720 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:47.307359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-a556e064-d2fe-495f-904d-bbc50d4931d7 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1258 microversion: 2.1 time: 0.159209 Jun 24 08:29:47.307896 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 561/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:47 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:48.324664 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:48.325320 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:48.331582 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:48.332022 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:48.332804 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:48.333287 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:48.461864 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:48.469322 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-406af890-8078-4023-9380-17939f6b47cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1442 microversion: 2.1 time: 0.148501 Jun 24 08:29:48.469870 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 563/1124] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:48 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1442 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:48.486029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:48.486697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:48.489198 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:48.494440 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:48.495394 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:48.495618 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:48.496058 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:48.631511 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:48.639026 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4ea75a36-c76a-42b4-a496-e800e916dfbb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1442 microversion: 2.1 time: 0.156893 Jun 24 08:29:48.639607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 562/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:48 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:50.785681 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:50.786368 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:50.792050 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell0:SELECT=2 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.794082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:50.794528 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:50.795304 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:50.795735 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:50.962544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:50.970744 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5a9b0b29-d7c8-4cba-9087-33fbba64f893 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1594 microversion: 2.1 time: 0.189148 Jun 24 08:29:50.971815 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 564/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:50 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1594 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:50.993815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-7ab2aef4-b0cd-4029-a170-3902422bfd73 req-30f1ba23-39a8-4f76-b6be-d74ba6944473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:51.002779 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7ab2aef4-b0cd-4029-a170-3902422bfd73 req-30f1ba23-39a8-4f76-b6be-d74ba6944473 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:51.003327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-7ab2aef4-b0cd-4029-a170-3902422bfd73 req-30f1ba23-39a8-4f76-b6be-d74ba6944473 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:51.016114 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-7ab2aef4-b0cd-4029-a170-3902422bfd73 req-30f1ba23-39a8-4f76-b6be-d74ba6944473 service nova] Creating event network-changed:63717731-c5c4-450f-afb5-a1b6a31dd3ef for instance a806a5c6-8671-407e-9065-5c025b344310 on hv-cinder-83482 Jun 24 08:29:51.021654 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-7ab2aef4-b0cd-4029-a170-3902422bfd73 req-30f1ba23-39a8-4f76-b6be-d74ba6944473 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104153 Jun 24 08:29:51.022515 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 563/1127] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:29:53.601611 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-a49d624d-ace0-4274-bde3-bbc7e34ecbc0 req-d644cd62-e31d-4f6f-b30e-eddd883e358a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:53.608709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:53.611092 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-a49d624d-ace0-4274-bde3-bbc7e34ecbc0 req-d644cd62-e31d-4f6f-b30e-eddd883e358a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:53.611537 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-a49d624d-ace0-4274-bde3-bbc7e34ecbc0 req-d644cd62-e31d-4f6f-b30e-eddd883e358a service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:53.622520 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-a49d624d-ace0-4274-bde3-bbc7e34ecbc0 req-d644cd62-e31d-4f6f-b30e-eddd883e358a service nova] Creating event network-changed:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:29:53.627696 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-a49d624d-ace0-4274-bde3-bbc7e34ecbc0 req-d644cd62-e31d-4f6f-b30e-eddd883e358a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030152 Jun 24 08:29:53.628520 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 565/1128] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:55.932106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-709620424"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:55.935927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:55.939321 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:55.939791 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:55.940570 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:55.941050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:56.069803 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.network.security_group_api [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Adding security group 1b76fc3a-4a24-450f-94c0-9d60afa84858 to port fde8cbab-b155-496b-a531-cdab3f3238cb Jun 24 08:29:56.498444 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-758fbcc4-2d76-42d4-8cf0-938d57996cc0 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/action" status: 202 len: 0 microversion: 2.1 time: 0.571884 Jun 24 08:29:56.499390 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 564/1129] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:29:55 2022] POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:29:56.510008 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:29:56.510499 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-ca56e957-db56-44cb-90db-d9c64dfa342c req-8d7f5db1-6996-47d6-8db0-c8b697b7afdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:29:56.511922 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:29:56.521266 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-ca56e957-db56-44cb-90db-d9c64dfa342c req-8d7f5db1-6996-47d6-8db0-c8b697b7afdd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:56.524003 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-ca56e957-db56-44cb-90db-d9c64dfa342c req-8d7f5db1-6996-47d6-8db0-c8b697b7afdd service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:56.526401 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:56.526867 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:56.527643 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:29:56.528080 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:29:56.547367 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-ca56e957-db56-44cb-90db-d9c64dfa342c req-8d7f5db1-6996-47d6-8db0-c8b697b7afdd service nova] Creating event network-changed:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:29:56.554654 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-ca56e957-db56-44cb-90db-d9c64dfa342c req-8d7f5db1-6996-47d6-8db0-c8b697b7afdd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050200 Jun 24 08:29:56.555602 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 566/1130] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:29:56.701598 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:29:56.712828 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c07c52a1-072d-4ea7-91b9-5fd444a7ada6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1759 microversion: 2.1 time: 0.207745 Jun 24 08:29:56.726247 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 565/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:29:56 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1759 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:19.434111 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:30:19.435152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:19.437630 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.442477 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:19.442926 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:19.443656 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:19.444081 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:19.701316 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6a0082a6-224a-42ee-9d18-8b8b0e6f16a9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/action" status: 202 len: 0 microversion: 2.1 time: 0.272606 Jun 24 08:30:19.702204 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 567/1132] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:30:19 2022] POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:30:19.709989 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:19.710592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:19.712865 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=7 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.714081 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=68 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.718801 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:19.719245 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:19.719996 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:19.720455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:19.864054 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:19.873089 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-7d643023-25d0-40a6-a209-221d5465b2ea tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1751 microversion: 2.1 time: 0.166866 Jun 24 08:30:19.873757 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 566/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:19 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:20.892024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:20.892749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:20.898864 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:20.899308 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:20.900064 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:20.900534 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:21.043844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:21.051806 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-642f2a04-3a5e-487b-adea-3bcdbf5d66d4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.164430 Jun 24 08:30:21.052402 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 568/1134] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:20 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:22.069328 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:22.070031 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:22.076871 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:22.077324 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:22.078090 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:22.078527 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:22.222117 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:22.230733 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c822ce6a-4ca9-4382-936f-e12a8b0b060b tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.165280 Jun 24 08:30:22.231314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 567/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:22 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:23.247890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:23.248513 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:23.254830 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:23.255267 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:23.256013 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:23.256465 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:23.397820 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:23.406238 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0f74ec79-8116-4495-9d00-69d78d8f6db9 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.163164 Jun 24 08:30:23.406788 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 569/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:23 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:24.423374 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:24.424010 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:24.430512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:24.430960 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:24.431709 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:24.432144 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:24.581307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:24.589506 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e7727799-4320-40f3-8fc9-35053727cb1d tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.169962 Jun 24 08:30:24.590077 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 568/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:24 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:25.606767 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:25.607376 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:25.613745 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:25.614187 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:25.614939 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:25.615373 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:25.753623 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:25.762559 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e4811d24-06ee-425e-8d64-7e0f8ce76535 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.158789 Jun 24 08:30:25.763117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 570/1138] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:25 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:26.780472 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:26.781083 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:26.787617 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:26.788056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:26.788838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:26.789266 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:26.942180 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:26.950691 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f68dc584-bed9-4711-b733-b9c2e5421a5c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.174834 Jun 24 08:30:26.951253 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 569/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:26 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:27.968070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:27.968713 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:27.975062 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:27.975497 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:27.976266 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:27.976694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:28.121291 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:28.129221 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-37c45f98-3fa9-49b3-85b0-cf30ffc5caac tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.166294 Jun 24 08:30:28.129782 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:27 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:29.146929 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:29.147566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:29.154491 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:29.154931 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:29.155740 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:29.156168 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:29.299210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:29.307072 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-42e491e5-cd15-43d1-b6d9-4b64a8f7b84c tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.164099 Jun 24 08:30:29.307626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 570/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:29 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:30.325904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:30.326494 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:30.333054 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:30.333501 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:30.334268 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:30.334829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:30.480573 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:30.488578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-20ecf09d-a737-4030-88ef-16cf324c10d7 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.167513 Jun 24 08:30:30.489213 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 572/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:30 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:31.506641 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:31.507250 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:31.514382 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:31.514833 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:31.515580 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:31.516014 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:31.657446 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:31.665486 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-bfcfdd88-4884-43a1-a63f-545153ce95f3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.162702 Jun 24 08:30:31.666050 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 571/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:31 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:32.682627 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:32.683483 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:32.689836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:32.690275 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:32.691018 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:32.691467 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:32.834103 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:32.842705 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-54373c25-7d9e-433d-9972-877fbae37727 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.163980 Jun 24 08:30:32.843256 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:32 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:33.860259 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:33.860808 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:33.867148 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:33.867587 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:33.868359 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:33.868789 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:34.008478 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:34.016379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0af58498-c81b-4d96-8fcf-512b306a4e00 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.160121 Jun 24 08:30:34.016933 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 572/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:33 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:35.033566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:35.034181 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:35.040579 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:35.041026 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:35.041780 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:35.042223 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:35.184785 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:35.192844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c1571a7e-8237-4ae2-8ff0-74f4338d40c4 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.163190 Jun 24 08:30:35.193400 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 574/1146] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:35 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:36.210003 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:36.210593 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:36.217000 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:36.217482 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:36.218228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:36.218656 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:36.359958 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:36.366861 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c97ccb0f-2c83-432e-b786-1675cc7345cc tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1756 microversion: 2.1 time: 0.160633 Jun 24 08:30:36.367432 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 573/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:36 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:37.384954 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:30:37.385522 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:30:37.393149 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:37.393588 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:37.394329 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:30:37.394753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:30:37.533957 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:30:37.541855 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-23e7362c-a2cc-441b-89f1-57a883fb662a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1759 microversion: 2.1 time: 0.160930 Jun 24 08:30:37.542423 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 575/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:30:37 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:13.220314 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-709620424"}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:31:13.220943 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:13.222848 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=16 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.223489 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=48 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.228164 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:13.228659 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:13.229405 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:13.229836 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:13.359902 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.network.security_group_api [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Removing security group 1b76fc3a-4a24-450f-94c0-9d60afa84858 from port fde8cbab-b155-496b-a531-cdab3f3238cb Jun 24 08:31:13.755695 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-041fcd05-b150-4077-ad0f-23925558b4e3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/action" status: 202 len: 0 microversion: 2.1 time: 0.538548 Jun 24 08:31:13.759592 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 574/1149] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:31:13 2022] POST /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:31:13.768332 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-9135d6fe-152d-4885-9a01-17880bae106d req-1648deba-a1ce-4b7d-b044-79d655c943f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:31:13.772452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=21 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.773113 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.775672 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-9135d6fe-152d-4885-9a01-17880bae106d req-1648deba-a1ce-4b7d-b044-79d655c943f2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:13.776337 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-9135d6fe-152d-4885-9a01-17880bae106d req-1648deba-a1ce-4b7d-b044-79d655c943f2 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:13.797673 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-9135d6fe-152d-4885-9a01-17880bae106d req-1648deba-a1ce-4b7d-b044-79d655c943f2 service nova] Creating event network-changed:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:31:13.806504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-9135d6fe-152d-4885-9a01-17880bae106d req-1648deba-a1ce-4b7d-b044-79d655c943f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045312 Jun 24 08:31:13.807452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 576/1150] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:31:15.092009 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:15.092525 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:15.099528 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:15.099978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:15.100761 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:15.101194 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:15.182396 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lazy-loading 'services' on Instance uuid 3f079dd7-0d01-4fb2-a39f-089f07b76633 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:31:15.377638 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-43884405-5fdd-4f6c-8277-e4b68129c080 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments/f9b3b103-3116-45b0-b279-72e589af50b6" status: 202 len: 0 microversion: 2.1 time: 0.289914 Jun 24 08:31:15.381474 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 575/1151] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:31:15 2022] DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments/f9b3b103-3116-45b0-b279-72e589af50b6 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:31:15.388079 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:15.389264 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:15.398504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:15.399093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:15.399978 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:15.400641 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:15.430616 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2cde8030-39a4-47dd-80b4-90130d51d5cb tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047619 Jun 24 08:31:15.431224 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 577/1152] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:31:15 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:31:15.824562 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-e822b05a-ad08-4e4b-86f4-6d627f933d10 req-3d83939b-6985-4488-a562-31ab2683d909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:31:15.833684 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e822b05a-ad08-4e4b-86f4-6d627f933d10 req-3d83939b-6985-4488-a562-31ab2683d909 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:15.834122 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e822b05a-ad08-4e4b-86f4-6d627f933d10 req-3d83939b-6985-4488-a562-31ab2683d909 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:15.845185 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-e822b05a-ad08-4e4b-86f4-6d627f933d10 req-3d83939b-6985-4488-a562-31ab2683d909 service nova] Creating event network-changed:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:31:15.850481 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-e822b05a-ad08-4e4b-86f4-6d627f933d10 req-3d83939b-6985-4488-a562-31ab2683d909 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029963 Jun 24 08:31:15.851306 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 576/1153] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:31:16.443934 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:16.444890 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:16.452448 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:16.452893 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:16.453690 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:16.454117 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:16.489019 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d29a0754-cc92-4344-83f1-4633731fd60a tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049177 Jun 24 08:31:16.489854 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 578/1154] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:31:16 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:31:17.504178 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:17.505228 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:17.511366 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:17.511812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:17.512607 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:17.513057 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:17.540626 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8ba66e58-583d-439b-9060-6ffabc54d075 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041560 Jun 24 08:31:17.541214 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 577/1155] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 24 08:31:17 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:31:17.551541 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:17.552067 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:17.558352 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:17.558791 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:17.559540 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:17.559995 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:17.632991 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] HTTP exception thrown: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 is not attached to volume f9b3b103-3116-45b0-b279-72e589af50b6 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Request method failure captured: Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments/f9b3b103-3116-45b0-b279-72e589af50b6 HTTP/1.1 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXXF8uYcxPEEILYdhOEF9DaajqEIlr8yuyhi4lXj4W75idqNWh282TG62hIABEh53I555o4VxQXJrpfn6Wnc_B1XayEsJpwL6U2yI6xnza4zC--ozEqdUzqeZu_ZLIu-ff6R6Eiksqh0KccUwgWnsBRUSfnO5gYP5BQSBPbiNUuX8y4 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: c9cf7969a63e46e9aeef5dc53410d51b Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-TestMinimumBasicScenario-814688267 Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:31:17.635351 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c9cf7969a63e46e9aeef5dc53410d51b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c9cf7969a63e46e9aeef5dc53410d51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c9cf7969a63e46e9aeef5dc53410d51b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c9cf7969a63e46e9aeef5dc53410d51b"}]}] Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-TestMinimumBasicScenario-814688267 Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: c9cf7969a63e46e9aeef5dc53410d51b Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-TestMinimumBasicScenario-814688267 Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-TestMinimumBasicScenario-814688267-project Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: f45b823dc34b4c17818b1afec6c33d0b Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-TestMinimumBasicScenario-814688267-project Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:31:17.637263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 is not attached to volume f9b3b103-3116-45b0-b279-72e589af50b6 Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'server_id': '3f079dd7-0d01-4fb2-a39f-089f07b76633', 'id': 'f9b3b103-3116-45b0-b279-72e589af50b6'} Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f9b3b103-3116-45b0-b279-72e589af50b6. Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:31:17.638364 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 is not attached to volume f9b3b103-3116-45b0-b279-72e589af50b6 Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 is not attached to volume f9b3b103-3116-45b0-b279-72e589af50b6 Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:31:17.640014 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Returning 404 to user: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 is not attached to volume f9b3b103-3116-45b0-b279-72e589af50b6 {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:31:17.641424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0586c286-53b6-4f11-a5bc-f13cc4dd6478 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments/f9b3b103-3116-45b0-b279-72e589af50b6" status: 404 len: 154 microversion: 2.1 time: 0.089984 Jun 24 08:31:17.641424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 579/1156] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 24 08:31:17 2022] DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633/os-volume_attachments/f9b3b103-3116-45b0-b279-72e589af50b6 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:31:18.928748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:18.929242 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:18.935713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:18.936160 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:18.936941 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:18.937373 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:18.962748 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Going to try to terminate instance {{(pid=118296) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:31:19.211327 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-3906335a-c7f3-4cf5-99ba-b378f9386033 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 204 len: 0 microversion: 2.1 time: 0.286892 Jun 24 08:31:19.211835 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 578/1157] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:31:18 2022] DELETE /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:19.220180 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:19.228516 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:19.228798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:19.229245 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:19.230003 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:19.230431 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:19.363563 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:19.370989 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-87b0ecde-bb1f-4722-bbe8-455f4e657581 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1554 microversion: 2.1 time: 0.154797 Jun 24 08:31:19.371544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 580/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:19 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:20.389022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:20.389708 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:20.396765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:20.397207 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:20.397953 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:20.398379 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:20.528897 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:20.536282 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-cb4430d3-af87-41f4-81c9-0d9b03ec25a3 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1554 microversion: 2.1 time: 0.151519 Jun 24 08:31:20.536839 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 579/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:20 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:21.553153 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:21.553676 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:21.560036 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:21.560504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:21.561257 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:21.561686 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:21.695860 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:21.703318 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c836c860-4968-43b6-801b-8ae6a8146812 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1554 microversion: 2.1 time: 0.154057 Jun 24 08:31:21.703883 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 581/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:21 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:21.962817 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-d4330076-6c43-413e-9aa1-6e036a298e6f req-59f0ef69-5518-4a65-9aac-3d806c287af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f079dd7-0d01-4fb2-a39f-089f07b76633", "name": "network-vif-deleted", "tag": "fde8cbab-b155-496b-a531-cdab3f3238cb"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:31:21.971342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-d4330076-6c43-413e-9aa1-6e036a298e6f req-59f0ef69-5518-4a65-9aac-3d806c287af1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:21.971889 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-d4330076-6c43-413e-9aa1-6e036a298e6f req-59f0ef69-5518-4a65-9aac-3d806c287af1 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:21.982815 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-d4330076-6c43-413e-9aa1-6e036a298e6f req-59f0ef69-5518-4a65-9aac-3d806c287af1 service nova] Creating event network-vif-deleted:fde8cbab-b155-496b-a531-cdab3f3238cb for instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 on hv-cinder-83482 Jun 24 08:31:21.988074 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-d4330076-6c43-413e-9aa1-6e036a298e6f req-59f0ef69-5518-4a65-9aac-3d806c287af1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028786 Jun 24 08:31:21.988718 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 580/1161] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:31:22.720829 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:22.721434 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:22.728836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:22.729285 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:22.730034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:22.730463 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:22.762337 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:22.762783 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:22.763230 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.objects.instance [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lazy-loading 'fault' on Instance uuid 3f079dd7-0d01-4fb2-a39f-089f07b76633 {{(pid=118295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:31:22.807070 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b823dc34b4c17818b1afec6c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cf7969a63e46e9aeef5dc53410d51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:22.815107 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3bc9f46c-bae5-44e9-b277-701108fcd454 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 200 len: 1347 microversion: 2.1 time: 0.098132 Jun 24 08:31:22.819417 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 582/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:22 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 1347 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:23.834044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:23.834728 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] [instance: 3f079dd7-0d01-4fb2-a39f-089f07b76633] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:23.840967 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:23.841422 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:23.842149 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:23.842576 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:23.855424 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.wsgi [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] HTTP exception thrown: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 could not be found. Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Request method failure captured: Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: request: GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 HTTP/1.1 Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept: application/json Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Accept-Encoding: identity Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Connection: close Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Length: 0 Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Content-Type: application/json Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Host: 10.222.0.42 Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Openstack-System-Scope: None Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: User-Agent: python-urllib3/1.26.9 Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Auth-Token: gAAAAABitXXF8uYcxPEEILYdhOEF9DaajqEIlr8yuyhi4lXj4W75idqNWh282TG62hIABEh53I555o4VxQXJrpfn6Wnc_B1XayEsJpwL6U2yI6xnza4zC--ozEqdUzqeZu_ZLIu-ff6R6Eiksqh0KccUwgWnsBRUSfnO5gYP5BQSBPbiNUuX8y4 Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Id: None Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Domain-Name: None Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Identity-Status: Confirmed Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Is-Admin-Project: True Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Id: default Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Domain-Name: Default Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Id: c9cf7969a63e46e9aeef5dc53410d51b Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Project-Name: tempest-TestMinimumBasicScenario-814688267 Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Role: reader,member Jun 24 08:31:23.857029 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Roles: reader,member Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c9cf7969a63e46e9aeef5dc53410d51b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c9cf7969a63e46e9aeef5dc53410d51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c9cf7969a63e46e9aeef5dc53410d51b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c9cf7969a63e46e9aeef5dc53410d51b"}]}] Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant: tempest-TestMinimumBasicScenario-814688267 Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Id: c9cf7969a63e46e9aeef5dc53410d51b Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-Tenant-Name: tempest-TestMinimumBasicScenario-814688267 Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User: tempest-TestMinimumBasicScenario-814688267-project Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Id: default Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Domain-Name: Default Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Id: f45b823dc34b4c17818b1afec6c33d0b Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: X-User-Name: tempest-TestMinimumBasicScenario-814688267-project Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: method: > Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: exception: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 could not be found. Jun 24 08:31:23.858529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: action_args: {'id': '3f079dd7-0d01-4fb2-a39f-089f07b76633'} Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 could not be found. Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:31:23.859522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 could not be found. Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 could not be found. Jun 24 08:31:23.861301 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: ERROR nova.api.openstack.wsgi Jun 24 08:31:23.863462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Returning 404 to user: Instance 3f079dd7-0d01-4fb2-a39f-089f07b76633 could not be found. {{(pid=118296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:31:23.863462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-da0d31c9-ff37-491a-8323-fa431b7cba34 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633" status: 404 len: 111 microversion: 2.1 time: 0.029544 Jun 24 08:31:23.863462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 581/1163] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:23 2022] GET /compute/v2.1/servers/3f079dd7-0d01-4fb2-a39f-089f07b76633 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:31:23.867432 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-6581af5f-d5f8-4833-9822-32bc2053b9e6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] Calling method '.version_select at 0x7f1496354af0>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:23.949273 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-6581af5f-d5f8-4833-9822-32bc2053b9e6 tempest-TestMinimumBasicScenario-814688267 tempest-TestMinimumBasicScenario-814688267-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-184635921" status: 202 len: 0 microversion: 2.1 time: 0.085506 Jun 24 08:31:23.949844 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 583/1164] 10.222.0.42 () {58 vars in 1268 bytes} [Fri Jun 24 08:31:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-184635921 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:31:48.820406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:31:48.821012 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:48.823100 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.823738 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.828462 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:48.828910 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:48.829657 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:48.830088 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:48.852904 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lazy-loading 'flavor' on Instance uuid a806a5c6-8671-407e-9065-5c025b344310 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:31:49.135046 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c059cb39-4f1b-451a-bbbb-019382699c73 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "POST /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310/action" status: 202 len: 0 microversion: 2.1 time: 0.319031 Jun 24 08:31:49.135538 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 582/1165] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:31:48 2022] POST /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:31:49.141227 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=40 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:49.142088 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:49.146116 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:49.146721 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:49.152652 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:49.153095 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:49.153868 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:49.154291 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:49.292488 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:49.300164 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-2fb581a8-2c85-4544-bc15-2256af234ac4 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.160332 Jun 24 08:31:49.300777 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 584/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:49 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:50.199833 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:31:50.200522 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:31:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:31:50.320085 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:50.320812 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:50.326975 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:50.327417 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:50.328166 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:50.328625 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:50.457661 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:50.465696 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-49ece31b-df2e-4d65-8917-08d0c9a7b861 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.150865 Jun 24 08:31:50.466262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 583/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:50 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:50.804452 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:31:50.805068 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:31:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:31:51.483565 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:51.484162 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:51.490670 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:51.491216 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:51.492525 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:51.492960 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:51.625144 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:51.633430 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-e6fdbf7c-cfd9-4527-85ad-5fe4f3ca444e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.154100 Jun 24 08:31:51.633976 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 585/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:51 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:52.650383 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:52.650986 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:52.657483 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:52.657925 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:52.658676 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:52.659106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:52.789828 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:52.797573 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-f22f0144-5370-4971-a3f7-85afbf466eeb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.151232 Jun 24 08:31:52.804765 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 584/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:52 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:53.815030 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:53.815636 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:53.822610 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:53.823051 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:53.823802 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:53.824284 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:53.951469 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:53.958903 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-8020b66b-5bd4-4bed-8bc3-410daf11bd98 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.147980 Jun 24 08:31:53.959456 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 586/1170] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:53 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:54.976139 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:54.976773 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:54.983174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:54.983619 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:54.984408 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:54.984838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:55.132741 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:55.140261 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0bfcda36-f931-4d8d-9fdc-0fa80b915d88 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.168006 Jun 24 08:31:55.140827 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 585/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:54 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:56.157424 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:56.158028 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:56.164943 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:56.165384 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:56.166130 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:56.166556 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:56.296152 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:56.303500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f8891916-90c4-448d-9476-2ce8b88deeab tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.149920 Jun 24 08:31:56.304692 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 587/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:56 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:57.321965 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:57.322566 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:57.329086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:57.329529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:57.330271 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:57.330697 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:57.463173 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:57.470542 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-c1f57b38-e762-4457-8e7c-fce3d79b2612 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.153288 Jun 24 08:31:57.471092 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 586/1173] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:57 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:58.487602 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:58.488222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:58.494587 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:58.495031 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:58.495779 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:58.496224 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:58.627755 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:58.635970 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-046641ca-9f8d-4064-80e8-6d0c6efbd260 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.152256 Jun 24 08:31:58.636578 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 588/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:58 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:59.467589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:31:59.468108 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:31:59.653471 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:31:59.653993 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:31:59.660622 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:59.661069 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:59.662455 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:31:59.663053 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:31:59.796760 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:31:59.805227 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-5cbd2d19-de44-44f6-b9b2-79a202d0bacc tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.155681 Jun 24 08:31:59.805793 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 587/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:31:59 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:00.823093 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:00.823769 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:00.830115 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:00.830552 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:00.831295 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:00.831718 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:00.961303 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:00.968626 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-21ce4a33-f17e-4384-8bee-2e1495de3a3d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.149794 Jun 24 08:32:00.969172 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 589/1176] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:00 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:01.985732 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:01.986337 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:01.993366 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:01.993810 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:01.994555 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:01.994984 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:02.125900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:02.134561 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-e9233871-d45b-45f4-99df-1d69c5e2512c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.152668 Jun 24 08:32:02.135121 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 588/1177] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:01 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:03.151720 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:03.152297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:03.159011 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:03.159479 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:03.160256 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:03.160684 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:03.296902 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:03.304837 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-d30a9575-af5b-47a4-a0bf-abebc9e7f532 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1568 microversion: 2.1 time: 0.157265 Jun 24 08:32:03.305394 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 590/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:03 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:03.322512 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:32:03.323085 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:03.329027 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:03.329475 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:03.330229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:03.330678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:03.539070 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-914ac84e-f69e-4a78-a762-4beb5bc3ba91 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "POST /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310/action" status: 202 len: 0 microversion: 2.1 time: 0.221047 Jun 24 08:32:03.539680 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 589/1179] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 24 08:32:03 2022] POST /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:32:03.547911 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:03.548545 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:03.554887 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:03.555839 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:03.556222 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:03.556659 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:03.700547 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:03.708443 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-1aa0081a-5cfa-47d5-959b-de83881578a6 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1576 microversion: 2.1 time: 0.164390 Jun 24 08:32:03.709289 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 591/1180] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:03 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:04.727794 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:04.728423 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:04.734406 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:04.734850 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:04.735610 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:04.736044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:04.870908 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:04.878529 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-141731fb-4886-4b6e-b5c5-e61dc01060cb tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1516 microversion: 2.1 time: 0.155795 Jun 24 08:32:04.879086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 590/1181] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:04 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:05.894942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:05.895544 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:05.902425 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:05.902860 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:05.903600 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:05.904024 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:06.033798 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:06.043501 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-59e04c02-08f2-4f95-8031-ed8346c4ac97 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1518 microversion: 2.1 time: 0.152340 Jun 24 08:32:06.044226 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 592/1182] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:05 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:06.145942 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-e034b48e-b9bd-428f-9ecf-0cca210177ce req-720cb85a-16d3-4d6a-97b9-250a0bc74cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "name": "network-vif-unplugged", "status": "completed", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:32:06.155589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e034b48e-b9bd-428f-9ecf-0cca210177ce req-720cb85a-16d3-4d6a-97b9-250a0bc74cf6 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:06.162900 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-e034b48e-b9bd-428f-9ecf-0cca210177ce req-720cb85a-16d3-4d6a-97b9-250a0bc74cf6 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:06.169056 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.compute.server_external_events [req-e034b48e-b9bd-428f-9ecf-0cca210177ce req-720cb85a-16d3-4d6a-97b9-250a0bc74cf6 service nova] Unable to find a host for instance a806a5c6-8671-407e-9065-5c025b344310. Dropping event network-vif-unplugged {{(pid=118296) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 08:32:06.170042 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-e034b48e-b9bd-428f-9ecf-0cca210177ce req-720cb85a-16d3-4d6a-97b9-250a0bc74cf6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027915 Jun 24 08:32:06.170786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 591/1183] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 08:32:07.061297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:07.061910 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:07.068606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:07.069048 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:07.070391 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:07.070824 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:07.205077 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:07.213695 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-3dd837e9-f277-47de-b389-5ce793492d1e tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.156295 Jun 24 08:32:07.214258 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 593/1184] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:07 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:08.231024 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:08.239862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:08.239862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:08.239862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:08.239862 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:08.240302 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:08.369262 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:08.376774 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-194d260e-1c40-42fc-a390-a5059d367fbe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.150259 Jun 24 08:32:08.377335 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 592/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:08 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:09.394404 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:09.395021 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:09.402191 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:09.402637 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:09.403389 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:09.403822 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:09.535219 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:09.542785 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-489d2082-b743-4525-8b91-3c46a057449d tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.152233 Jun 24 08:32:09.543345 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 594/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:09 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:10.560274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:10.560916 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:10.567951 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:10.568436 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:10.572849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:10.572849 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:10.703220 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:10.710731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ef83a5c3-1602-47de-b16d-a633d94e5275 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.154807 Jun 24 08:32:10.711300 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 593/1187] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:10 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:11.727825 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:11.728466 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:11.735040 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:11.735483 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:11.736251 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:11.736688 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:11.867718 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:11.875937 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-f61a5b77-255e-4aec-ad08-f5241679124c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.151919 Jun 24 08:32:11.876543 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 595/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:11 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:12.893702 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:12.894294 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:12.900674 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:12.901306 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:12.902019 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:12.902447 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:13.035498 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:13.043543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0011202f-78f7-445e-98b0-a3efafed03a5 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.153750 Jun 24 08:32:13.044132 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 594/1189] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:12 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:14.061437 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:14.062039 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:14.068495 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:14.069129 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:14.069716 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:14.070150 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:14.205119 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:14.212951 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-5ceff9d7-e05e-4751-8008-f1c09511fc85 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.156378 Jun 24 08:32:14.213629 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 596/1190] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:14 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:15.230326 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:15.230946 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:15.237585 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:15.238034 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:15.238786 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:15.239225 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:15.370919 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:15.378399 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-4514ef80-1e52-4521-81a8-e957c633d86c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.151933 Jun 24 08:32:15.378962 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 595/1191] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:15 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:16.231034 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-67b5047c-db10-4b07-b3ad-db6cafd1be6b req-e2eaf649-1a3f-485d-a269-c9ff073de142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "name": "network-vif-plugged", "status": "completed", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:32:16.239504 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-67b5047c-db10-4b07-b3ad-db6cafd1be6b req-e2eaf649-1a3f-485d-a269-c9ff073de142 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:16.239942 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-67b5047c-db10-4b07-b3ad-db6cafd1be6b req-e2eaf649-1a3f-485d-a269-c9ff073de142 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:16.250968 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-67b5047c-db10-4b07-b3ad-db6cafd1be6b req-e2eaf649-1a3f-485d-a269-c9ff073de142 service nova] Creating event network-vif-plugged:63717731-c5c4-450f-afb5-a1b6a31dd3ef for instance a806a5c6-8671-407e-9065-5c025b344310 on hv-cinder-83482 Jun 24 08:32:16.256006 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-67b5047c-db10-4b07-b3ad-db6cafd1be6b req-e2eaf649-1a3f-485d-a269-c9ff073de142 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030789 Jun 24 08:32:16.256606 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 597/1192] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:32:16.395493 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:16.396103 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:16.402731 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:16.403174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:16.403927 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:16.404392 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:16.408543 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:16.536857 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:16.545082 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dff341d8-01d6-44b2-b281-1a6a9354b7be tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.153361 Jun 24 08:32:16.545640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 596/1193] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:16 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:17.563947 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:17.565500 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:17.571696 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:17.572142 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:17.573971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:17.573971 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:17.721978 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:17.729805 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-0dc49552-f036-41c9-a7d7-af78533a15b2 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1574 microversion: 2.1 time: 0.170781 Jun 24 08:32:17.730392 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 598/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:17 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:32:18.747086 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:18.747678 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:32:18.754784 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:18.755229 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:18.755978 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:18.756437 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:18.886805 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:32:18.894210 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-8b2eaea3-2564-4aa4-ab8f-8f658209d838 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1561 microversion: 2.1 time: 0.151072 Jun 24 08:32:18.894768 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 597/1195] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:32:18 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:34.658473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:33:34.659580 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:33:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:33:38.875378 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_api:SELECT=30 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:38.876303 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG dbcounter [-] [118295] Writing DB stats nova_cell1:SELECT=86 {{(pid=118295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:38.879686 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_api:SELECT=34 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:38.880457 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG dbcounter [-] [118296] Writing DB stats nova_cell1:SELECT=10 {{(pid=118296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:38.881654 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:38.882350 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:33:38.884441 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [req-df011275-7e0a-4d72-9c92-6c89b7823a81 req-c7207dd2-5a59-4108-83c4-8b4fb9e1ba77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:38.891564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:38.891564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:38.891564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:38.891564 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:38.892560 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-df011275-7e0a-4d72-9c92-6c89b7823a81 req-c7207dd2-5a59-4108-83c4-8b4fb9e1ba77 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:38.893929 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [req-df011275-7e0a-4d72-9c92-6c89b7823a81 req-c7207dd2-5a59-4108-83c4-8b4fb9e1ba77 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:38.905836 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.compute.server_external_events [req-df011275-7e0a-4d72-9c92-6c89b7823a81 req-c7207dd2-5a59-4108-83c4-8b4fb9e1ba77 service nova] Creating event network-changed:63717731-c5c4-450f-afb5-a1b6a31dd3ef for instance a806a5c6-8671-407e-9065-5c025b344310 on hv-cinder-83482 Jun 24 08:33:38.912357 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [req-df011275-7e0a-4d72-9c92-6c89b7823a81 req-c7207dd2-5a59-4108-83c4-8b4fb9e1ba77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034894 Jun 24 08:33:38.914113 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 598/1196] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:38.918097 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Going to try to terminate instance {{(pid=118295) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:33:39.209753 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-4eb4ea8b-b3cd-4b7f-a388-f84a649c8d09 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 204 len: 0 microversion: 2.1 time: 0.335792 Jun 24 08:33:39.210694 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 599/1197] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 24 08:33:38 2022] DELETE /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:33:39.221609 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:39.222501 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:33:39.230240 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:39.230743 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:39.231584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:39.232022 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:39.369640 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:33:39.378964 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-0f8da48b-346c-4545-bd33-34c67e7906b1 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.163246 Jun 24 08:33:39.379776 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 599/1198] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:33:39 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:40.402179 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:40.402873 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:33:40.409973 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:40.410535 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:40.411297 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:40.411730 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:40.544082 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.policy [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118295) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:33:40.551646 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c9ec4c0c-5a7b-4e21-8ba8-7ced4991fb79 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1567 microversion: 2.1 time: 0.153813 Jun 24 08:33:40.552419 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 600/1199] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:33:40 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:41.570237 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:41.570838 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:33:41.577274 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:41.577713 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:41.578460 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:41.578886 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:41.695044 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:33:41.702630 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-ae4f81ec-2441-43e9-bbc4-fecf73ff6006 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1381 microversion: 2.1 time: 0.137578 Jun 24 08:33:41.703186 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 600/1200] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:33:41 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1381 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:41.724379 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [req-eb775d0b-2fd8-4192-9859-c89497d9115d req-7478998e-a471-4748-892a-9e0446b3bbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a806a5c6-8671-407e-9065-5c025b344310", "name": "network-vif-deleted", "tag": "63717731-c5c4-450f-afb5-a1b6a31dd3ef"}]} {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:41.732749 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-eb775d0b-2fd8-4192-9859-c89497d9115d req-7478998e-a471-4748-892a-9e0446b3bbf4 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:41.736279 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [req-eb775d0b-2fd8-4192-9859-c89497d9115d req-7478998e-a471-4748-892a-9e0446b3bbf4 service nova] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:41.744096 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.compute.server_external_events [req-eb775d0b-2fd8-4192-9859-c89497d9115d req-7478998e-a471-4748-892a-9e0446b3bbf4 service nova] Creating event network-vif-deleted:63717731-c5c4-450f-afb5-a1b6a31dd3ef for instance a806a5c6-8671-407e-9065-5c025b344310 on hv-cinder-83482 Jun 24 08:33:41.748984 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [req-eb775d0b-2fd8-4192-9859-c89497d9115d req-7478998e-a471-4748-892a-9e0446b3bbf4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 Jun 24 08:33:41.753778 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 601/1201] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 24 08:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:42.720174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:42.720800 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.compute.api [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118296) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:33:42.728106 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:42.728589 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:42.729342 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:42.729778 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:42.760064 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:42.760584 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG oslo_concurrency.lockutils [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:42.761031 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.objects.instance [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lazy-loading 'fault' on Instance uuid a806a5c6-8671-407e-9065-5c025b344310 {{(pid=118296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:33:42.801623 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.policy [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9150eafa2cc41f5ac56105976d658a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb93f2721d548d7b01475fb650d882f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118296) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:33:42.809160 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-dcf0636e-a189-4a80-8df4-05f8ed83b39c tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 200 len: 1223 microversion: 2.1 time: 0.092822 Jun 24 08:33:42.809716 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 601/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:33:42 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:43.827594 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '>' {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:43.828305 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.compute.api [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] [instance: a806a5c6-8671-407e-9065-5c025b344310] Fetching instance by UUID {{(pid=118295) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:33:43.835622 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:43.836058 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:43.836836 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:43.837263 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG oslo_concurrency.lockutils [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Lock "081d19cb-2fd5-4e7c-8144-7f74f0537b29" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:43.850329 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.wsgi [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] HTTP exception thrown: Instance a806a5c6-8671-407e-9065-5c025b344310 could not be found. Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Request method failure captured: Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: request: GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 HTTP/1.1 Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept: application/json Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Accept-Encoding: identity Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Connection: close Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Length: 0 Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Content-Type: application/json Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Host: 10.222.0.42 Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Openstack-System-Scope: None Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: User-Agent: python-urllib3/1.26.9 Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Auth-Token: gAAAAABitXXAtuAoc8dHDpD0DiB6HdgCk4yL-bbaGaEj-_x_ZC4tSl6tscuidmzruAZgJRERUdyfwGK984hBDoB3GQjZA5WW7QpUQT6dRUMZFa0Vx0iGAtca46EBrLwvO_6dOTfUk4lK4mxv1XkxFqQWMDNXm7LNIeefkK2FCYCpHQudOVTrIq0 Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Id: None Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Domain-Name: None Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Identity-Status: Confirmed Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Is-Admin-Project: True Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Id: default Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Domain-Name: Default Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Id: bdb93f2721d548d7b01475fb650d882f Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Project-Name: tempest-TestShelveInstance-1586578159 Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Role: reader,member Jun 24 08:33:43.851904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Roles: reader,member Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb93f2721d548d7b01475fb650d882f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb93f2721d548d7b01475fb650d882f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb93f2721d548d7b01475fb650d882f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb93f2721d548d7b01475fb650d882f"}]}] Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant: tempest-TestShelveInstance-1586578159 Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Id: bdb93f2721d548d7b01475fb650d882f Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-Tenant-Name: tempest-TestShelveInstance-1586578159 Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User: tempest-TestShelveInstance-1586578159-project Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Id: default Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Domain-Name: Default Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Id: a9150eafa2cc41f5ac56105976d658a2 Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: X-User-Name: tempest-TestShelveInstance-1586578159-project Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: method: > Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: exception: Instance a806a5c6-8671-407e-9065-5c025b344310 could not be found. Jun 24 08:33:43.853790 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: action_args: {'id': 'a806a5c6-8671-407e-9065-5c025b344310'} Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: {{(pid=118295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a806a5c6-8671-407e-9065-5c025b344310 could not be found. Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:33:43.854904 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a806a5c6-8671-407e-9065-5c025b344310 could not be found. Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a806a5c6-8671-407e-9065-5c025b344310 could not be found. Jun 24 08:33:43.856709 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: ERROR nova.api.openstack.wsgi Jun 24 08:33:43.858328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: DEBUG nova.api.openstack.wsgi [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Returning 404 to user: Instance a806a5c6-8671-407e-9065-5c025b344310 could not be found. {{(pid=118295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:33:43.858328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO nova.api.openstack.requestlog [None req-c7621083-4c68-4b43-927c-a330e4a0dd80 tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310" status: 404 len: 111 microversion: 2.1 time: 0.030446 Jun 24 08:33:43.858328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: [pid: 118295|app: 0|req: 602/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 24 08:33:43 2022] GET /compute/v2.1/servers/a806a5c6-8671-407e-9065-5c025b344310 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:33:44.091516 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: DEBUG nova.api.openstack.wsgi [None req-fd00d975-7788-493e-9508-f7d2731e64fe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] Calling method '.version_select at 0x7f14962795e0>' {{(pid=118296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:44.184078 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO nova.api.openstack.requestlog [None req-fd00d975-7788-493e-9508-f7d2731e64fe tempest-TestShelveInstance-1586578159 tempest-TestShelveInstance-1586578159-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-152769386" status: 202 len: 0 microversion: 2.1 time: 0.096429 Jun 24 08:33:44.184695 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: [pid: 118296|app: 0|req: 602/1204] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 24 08:33:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-152769386 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:35:10.812770 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:35:10.813399 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:35:19.475907 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:35:19.476391 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:36:50.210322 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:36:50.211045 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:36:54.666958 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:36:54.667473 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:38:30.820879 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:38:30.821566 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:38:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:38:39.485174 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:38:39.485769 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:38:50.445307 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:38:50.446052 dv-cinder-834822-6-iscsi devstack@n-api.service[118296]: Fri Jun 24 08:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:39:04.170747 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:39:04.171328 dv-cinder-834822-6-iscsi devstack@n-api.service[118295]: Fri Jun 24 08:39:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!